00000001:02000400:2.0F:1788832636.692408:0:2969:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788832655.450513:0:3192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788832656.992554:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 755 MB/s 00000001:01000000:3.0:1788832657.242080:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 655 MB/s 00000001:01000000:3.0:1788832657.494143:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3337 MB/s 00000020:02000000:2.0:1788832658.336381:0:3283:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_110_g063755c 00000400:02000000:1.0F:1788832659.302771:0:3298:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.141@tcp [8/256/0/180] 00008000:02000000:0.0F:1788832662.840587:0:3448:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788832710.009500:0:5248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788832719.362663:0:5834:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788832719.362669:0:5834:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788832719.363960:0:5834:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004c6fd1a6 00000080:02000400:2.0:1788832719.363973:0:5834:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788832719.374316:0:5834:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788832719.374327:0:5834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788832719.374363:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000d3e83aec) 00000020:00000080:2.0:1788832719.374380:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788832719.391960:0:5834:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788832719.392616:0:5834:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788832719.412692:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788832719.412731:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788832719.412906:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788832719.412957:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788832719.412978:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788832719.413314:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788832719.413321:0:5834:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788832719.413330:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a47dd 00000020:01000004:3.0:1788832719.413336:0:5834:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788832719.413341:0:5834:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788832719.413345:0:5834:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004c6fd1a6 from MGS 00000020:01000004:3.0:1788832719.413349:0:5834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788832719.413365:0:5834:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000dde85307) 00000020:00000080:3.0:1788832719.413375:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788832719.413471:0:5834:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004c6fd1a6 from MGS, refs=2 00080000:01000000:3.0:1788832719.413559:0:5834:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788832719.413566:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a47eb 00000100:00100000:3.0:1788832719.413648:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788832719.413933:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788832719.413939:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788832719.414383:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788832719.414389:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788832719.415201:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832719.415365:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788832719.415375:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788832719.416152:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788832719.416160:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788832719.416551:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788832719.416557:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788832719.417450:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832719.417453:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832719.417455:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832719.417925:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832719.417927:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832719.417929:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832719.418474:0:5834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788832719.423804:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788832719.669135:0:5834:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3243 MB/s 00000001:01000000:2.0:1788832719.918840:0:5834:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3291 MB/s 00000001:01000000:2.0:1788832720.168886:0:5834:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 567 MB/s 00000001:01000000:3.0:1788832720.419020:0:5834:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 731 MB/s 00080000:10000000:0.0:1788832720.439461:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1788832720.459138:0:5834:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788832720.459153:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788832720.459155:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788832720.464435:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00010000:00010000:0.0:1788832720.469900:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1788832720.469985:0:5834:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788832720.470044:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788832720.471915:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788832720.471962:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788832720.473933:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832720.474194:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788832720.474209:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788832720.475870:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788832720.475881:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788832720.476394:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788832720.476401:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788832720.477029:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788832720.477049:0:5834:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.141@tcp' 00000020:01000004:0.0:1788832720.477051:0:5834:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:2.0:1788832720.477198:0:5849:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:0.0:1788832720.477391:0:5834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.141@tcp (typ=mgc) 00000020:00000080:0.0:1788832720.477410:0:5834:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.141@tcp (00000000d6f77356) 00000020:00000080:0.0:1788832720.477425:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788832720.477508:0:5834:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000931079d7@MGC192.168.206.141@tcp: add connection 192.168.206.141@tcp at head 00010000:00010000:0.0:1788832720.477663:0:5834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.141@tcp-0 is initialized 00000040:01000000:0.0:1788832720.477669:0:5834:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.141@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788832720.482313:0:5850:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788832720.482782:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.141@tcp (uuid bd32c45e-9a6a-4349-b87e-107522b34816) 00000020:00000080:1.0:1788832720.482805:0:5834:0:(genops.c:1385:class_connect()) connect: client bd32c45e-9a6a-4349-b87e-107522b34816, cookie 0xd270a10c1c6a47f9 00000100:00080000:1.0:1788832720.482817:0:5834:0:(import.c:510:import_select_connection()) MGC192.168.206.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832720.482822:0:5834:0:(import.c:624:import_select_connection()) MGC192.168.206.141@tcp: import 00000000931079d7 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:1.0:1788832720.482873:0:5834:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e95cd9f4 x1875726994243712/t0(0) o250->MGC192.168.206.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832720.482900:0:5834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bd32c45e-9a6a-4349-b87e-107522b34816->MGS 00000020:01000004:1.0:1788832720.482922:0:5834:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788832720.482927:0:5834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788832720.482947:0:5834:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ead4f40f) 00000020:00000080:1.0:1788832720.482961:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788832720.483684:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e95cd9f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd32c45e-9a6a-4349-b87e-107522b34816:3313:1875726994243712:0@lo:250: 00000100:00100000:0.0:1788832720.488804:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832720.489964:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994243712 00000100:00100000:2.0:1788832720.489974:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994243712 00000100:00100000:2.0:1788832720.490014:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788832720.490021:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4fe2384 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1875726994243712:12345-0@lo:250: 00010000:00080000:2.0:1788832720.490046:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from bd32c45e-9a6a-4349-b87e-107522b34816@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:2.0:1788832720.490073:0:5846:0:(genops.c:1385:class_connect()) connect: client bd32c45e-9a6a-4349-b87e-107522b34816, cookie 0xd270a10c1c6a4807 00000100:00080000:2.0:1788832720.490818:0:5846:0:(import.c:65:import_set_state_nolock()) 00000000eac1a7e3 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832720.490911:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4fe2384 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+5:3313:x1875726994243712:12345-0@lo:250: Request processed in 888us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832720.490928:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788832720.491114:0:3313:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788832720.491122:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.141@tcp: connect to target with instance 0 00000100:00080000:2.0:1788832720.491130:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788832720.491135:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788832720.491138:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000931079d7 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788832720.491140:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788832720.491154:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788832720.493424:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e95cd9f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd32c45e-9a6a-4349-b87e-107522b34816:3313:1875726994243712:0@lo:250: 00000100:00100000:1.0:1788832720.500698:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832720.500921:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788832720.500927:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788832720.505315:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788832720.505329:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788832720.505847:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788832720.505854:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788832720.506501:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832720.506691:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788832720.506703:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788832720.512155:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788832720.512176:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788832720.545197:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832720.545450:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788832720.545456:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788832720.546657:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788832720.546666:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788832720.547344:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832720.547504:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788832720.547509:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788832720.550465:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788832720.550478:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788832720.554685:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832720.554939:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788832720.554946:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788832720.555575:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788832720.555582:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788832720.556994:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832720.557158:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788832720.557164:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788832720.562210:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788832720.562296:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788832720.598425:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788832720.598718:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788832720.598724:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788832720.603560:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788832720.603577:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788832720.613814:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788832720.613843:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788832720.616267:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788832720.616291:0:5834:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788832720.616297:0:5834:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.141@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788832720.616406:0:5834:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.141@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788832720.616438:0:5834:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.141@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788832720.616442:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788832720.616443:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788832720.616445:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832720.616446:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832720.616447:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832720.616448:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832720.616450:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832720.616451:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788832720.616452:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788832720.616453:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788832720.616454:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832720.616456:0:5834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788832720.616458:0:5834:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788832720.616461:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788832720.616462:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788832720.616463:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832720.616464:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832720.616465:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832720.616466:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832720.616467:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832720.616468:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788832720.616469:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788832720.616470:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788832720.616471:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832720.616471:0:5834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788832720.616505:0:5834:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788832720.616533:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d593f83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994243840:0@lo:253: 00000100:00100000:0.0:1788832720.616604:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832720.616663:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030d421fd going to sleep for 11 seconds 00000100:00100000:1.0:1788832720.616734:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994243840 00000100:00100000:1.0:1788832720.616765:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994243840 00000100:00100000:1.0:1788832720.616807:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832720.616815:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc128351 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+5:5834:x1875726994243840:12345-0@lo:253: 20000000:01000000:1.0:1788832720.616867:0:5848:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788832720.616870:0:5848:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788832720.617771:0:5869:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788832720.617839:0:5848:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788832720.618135:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832720.620479:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788832720.620955:0:5848:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788832720.620959:0:5848:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788832720.620964:0:5848:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788832720.620967:0:5848:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788832720.620983:0:5848:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788832720.621426:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832720.621717:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788832720.621823:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788832720.621947:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788832720.621999:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788832720.622135:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788832720.622360:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788832720.622370:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788832720.622421:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788832720.622429:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788832720.622463:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788832720.622470:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788832720.622500:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788832720.622841:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788832720.622953:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788832720.622958:0:5848:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788832720.622971:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832720.623649:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788832720.623662:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788832720.623700:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788832720.623839:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788832720.623971:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788832720.623984:0:5848:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788832720.624295:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788832720.624306:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788832720.624355:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788832720.624393:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788832720.624429:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788832720.624440:0:5848:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788832720.624558:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788832720.624569:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788832720.624603:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788832720.624634:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788832720.624867:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788832720.624916:0:5848:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788832720.624923:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788832720.625357:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788832720.625606:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788832720.626399:0:5848:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.141@tcp for mdt 20000000:01000000:1.0:1788832720.626403:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.141@tcp (null) (null) (null) 00000040:00080000:1.0:1788832720.626923:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788832720.626936:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788832720.626975:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788832720.626983:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.141@tcp (null) (null) 00000040:00080000:1.0:1788832720.627038:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788832720.627048:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788832720.627080:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788832720.627114:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788832720.627201:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788832720.627205:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788832720.627208:0:5848:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788832720.627236:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788832720.627318:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788832720.627348:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788832720.627350:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788832720.627886:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788832720.628359:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788832720.628403:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788832720.628472:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788832720.628484:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788832720.628486:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788832720.629149:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788832720.629400:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788832720.629450:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788832720.629483:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788832720.629501:0:5848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788832720.629503:0:5848:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788832720.629507:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788832720.629509:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788832720.629529:0:5848:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788832720.629535:0:5848:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788832720.631386:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788832720.631593:0:5848:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788832720.648716:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788832720.649246:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788832720.649321:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788832720.649341:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788832720.649361:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a480e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832720.649377:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a480e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832720.649385:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a480e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832720.649391:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a480e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832720.649396:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a480e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832720.649402:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a480e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832720.649408:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001ca515ae already unused, calling callback (000000009fba8ae1) 00010000:00010000:1.0:1788832720.649411:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a480e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832720.649417:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a480e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832720.649443:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a480e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832720.649450:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a480e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832720.649454:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a480e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788832720.649471:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788832720.867386:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc128351 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+5:5834:x1875726994243840:12345-0@lo:253: Request processed in 250566us (250776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832720.867399:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832720.867524:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d593f83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994243840:0@lo:253: 10000000:01000000:0.0:1788832720.867538:0:5834:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788832720.867541:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788832720.867543:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788832720.867545:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832720.867546:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788832720.867547:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832720.867549:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832720.867550:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832720.867551:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788832720.867553:0:5834:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788832720.867554:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832720.867555:0:5834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788832720.867573:0:5834:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004c6fd1a6 from lustre-MDT0000 10000000:01000000:0.0:1788832720.867597:0:5834:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788832720.867600:0:5834:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788832720.867604:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff984d06434d28 10000000:01000000:0.0:1788832720.867608:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832720.867614:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff984d06434d28 from 1 10000000:01000000:0.0:1788832720.867617:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788832720.867649:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: 00000000b2baf164/0xd270a10c1c6a4815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832720.867670:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: 00000000b2baf164/0xd270a10c1c6a4815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832720.867680:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: 00000000b2baf164/0xd270a10c1c6a4815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832720.867696:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d593f83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994243968:0@lo:101: 00000100:00100000:0.0:1788832720.867729:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832720.867924:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e7cd39bb going to sleep for 11 seconds 00000100:00100000:1.0:1788832720.868041:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994243968 00000100:00100000:1.0:1788832720.868048:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994243968 00000100:00100000:1.0:1788832720.868120:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832720.868127:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dc0dcdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+5:5834:x1875726994243968:12345-0@lo:101: 00010000:00010000:1.0:1788832720.868138:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832720.868149:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a481c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4815 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832720.868170:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a481c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4815 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832720.868179:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001ca515ae/0xd270a10c1c6a481c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4815 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832720.868186:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001ca515ae, rc 0) 00000100:00100000:1.0:1788832720.868225:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dc0dcdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+6:5834:x1875726994243968:12345-0@lo:101: Request processed in 99us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832720.868238:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788832720.868300:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d593f83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994243968:0@lo:101: 00010000:00010000:3.0:1788832720.868313:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: 00000000b2baf164/0xd270a10c1c6a4815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a481c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.868320:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: 00000000b2baf164/0xd270a10c1c6a4815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a481c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832720.868375:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bb5b464 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994244096:0@lo:501: 00000100:00100000:3.0:1788832720.868401:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832720.868498:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f224f4e0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832720.868606:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994244096 00000100:00100000:0.0:1788832720.868611:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994244096 00000100:00100000:0.0:1788832720.868632:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832720.868637:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa2bde72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+6:5834:x1875726994244096:12345-0@lo:501: 00000100:00100000:0.0:1788832720.868882:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa2bde72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+6:5834:x1875726994244096:12345-0@lo:501: Request processed in 244us (480us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788832720.868889:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788832720.869020:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bb5b464 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994244096:0@lo:501: 10000000:01000000:3.0:1788832720.869046:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788832720.869068:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: 00000000b2baf164/0xd270a10c1c6a4815 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a481c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869075:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: 00000000b2baf164/0xd270a10c1c6a4815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a481c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832720.869082:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984d2a26c800 10000000:01000000:3.0:1788832720.869086:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788832720.869090:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff984d2a26c800 10000000:01000000:3.0:1788832720.869092:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788832720.869094:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff984d2a26c800 from 1 10000000:01000000:3.0:1788832720.869097:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788832720.869115:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: 00000000ab0604ba/0xd270a10c1c6a4823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869121:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: 00000000ab0604ba/0xd270a10c1c6a4823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869128:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: 00000000ab0604ba/0xd270a10c1c6a4823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832720.869138:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bb5b464 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994244224:0@lo:101: 00000100:00100000:3.0:1788832720.869163:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832720.869190:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f224f4e0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832720.869208:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994244224 00000100:00100000:3.0:1788832720.869213:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994244224 00000100:00100000:3.0:1788832720.869232:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788832720.869237:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2965e0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+6:5834:x1875726994244224:12345-0@lo:101: 00010000:00010000:3.0:1788832720.869244:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832720.869254:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb897c12/0xd270a10c1c6a482a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4823 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869277:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb897c12/0xd270a10c1c6a482a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4823 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869284:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb897c12/0xd270a10c1c6a482a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4823 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869291:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb897c12, rc 0) 00000100:00100000:3.0:1788832720.869320:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2965e0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+7:5834:x1875726994244224:12345-0@lo:101: Request processed in 82us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832720.869325:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788832720.869355:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bb5b464 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994244224:0@lo:101: 00010000:00010000:3.0:1788832720.869364:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: 00000000ab0604ba/0xd270a10c1c6a4823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869370:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: 00000000ab0604ba/0xd270a10c1c6a4823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832720.869382:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788832720.869385:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: 00000000ab0604ba/0xd270a10c1c6a4823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869390:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: 00000000ab0604ba/0xd270a10c1c6a4823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832720.869395:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788832720.869398:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788832720.869401:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff984d2a26c800 10000000:01000000:3.0:1788832720.869404:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788832720.869411:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788832720.869413:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788832720.869425:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: 000000005df2fd23/0xd270a10c1c6a4831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869432:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: 000000005df2fd23/0xd270a10c1c6a4831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869438:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: 000000005df2fd23/0xd270a10c1c6a4831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832720.869449:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bb5b464 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994244352:0@lo:101: 00000100:00100000:3.0:1788832720.869473:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832720.869486:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f224f4e0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832720.869498:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994244352 00000100:00100000:3.0:1788832720.869501:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994244352 00000100:00100000:3.0:1788832720.869529:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788832720.869534:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019cc3867 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+7:5834:x1875726994244352:12345-0@lo:101: 00010000:00010000:3.0:1788832720.869540:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832720.869547:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009220a322/0xd270a10c1c6a4838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4831 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869559:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009220a322/0xd270a10c1c6a4838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4831 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869565:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009220a322/0xd270a10c1c6a4838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4831 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869570:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009220a322, rc 0) 00000100:00100000:3.0:1788832720.869597:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019cc3867 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+8:5834:x1875726994244352:12345-0@lo:101: Request processed in 63us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832720.869608:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788832720.869641:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bb5b464 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994244352:0@lo:101: 00010000:00010000:3.0:1788832720.869650:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: 000000005df2fd23/0xd270a10c1c6a4831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4838 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832720.869657:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: 000000005df2fd23/0xd270a10c1c6a4831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4838 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832720.869691:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bb5b464 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994244480:0@lo:501: 00000100:00100000:3.0:1788832720.869715:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832720.869728:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f224f4e0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832720.869739:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994244480 00000100:00100000:3.0:1788832720.869766:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994244480 00000100:00100000:3.0:1788832720.869905:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788832720.869912:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b6b6a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+8:5834:x1875726994244480:12345-0@lo:501: 00000100:00100000:3.0:1788832720.870135:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b6b6a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+9:5834:x1875726994244480:12345-0@lo:501: Request processed in 223us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832720.870141:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788832720.870278:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bb5b464 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994244480:0@lo:501: 00000100:00100000:0.0:1788832720.870306:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e27e7af3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994244608:0@lo:503: 00000100:00100000:0.0:1788832720.870343:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832720.870413:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000465f0016 going to sleep for 11 seconds 00000100:00100000:2.0:1788832720.870448:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994244608 00000100:00100000:2.0:1788832720.870453:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994244608 00000100:00100000:3.0:1788832720.870496:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788832720.870503:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000783fd203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+9:5834:x1875726994244608:12345-0@lo:503: 00000100:00100000:3.0:1788832720.870657:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000783fd203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+9:5834:x1875726994244608:12345-0@lo:503: Request processed in 155us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832720.870663:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788832720.870756:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e27e7af3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994244608:0@lo:503: 00000100:00100000:0.0:1788832720.871181:0:5876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e27e7af3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:5876:1875726994244736:0@lo:502: 00000100:00100000:0.0:1788832720.871218:0:5876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832720.871249:0:5876:0:(client.c:2715:ptlrpc_set_wait()) set 000000008904d534 going to sleep for 11 seconds 00000100:00100000:1.0:1788832720.871303:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994244736 00000100:00100000:1.0:1788832720.871308:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994244736 00000100:00100000:1.0:1788832720.871340:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832720.871346:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007130df5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+9:5876:x1875726994244736:12345-0@lo:502: 00000100:00100000:1.0:1788832720.871498:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007130df5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+9:5876:x1875726994244736:12345-0@lo:502: Request processed in 152us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832720.871505:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788832720.871625:0:5876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e27e7af3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:5876:1875726994244736:0@lo:502: 00000020:01000000:0.0:1788832720.871653:0:5876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832720.871664:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832720.871666:0:5876:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788832720.871671:0:5876:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788832720.871674:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832720.871685:0:5876:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d19e26a7) 00000020:00000080:0.0:1788832720.871702:0:5876:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788832720.871709:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788832720.871883:0:5876:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788832720.871890:0:5876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a4846 00000020:00000080:0.0:1788832720.872111:0:5876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788832720.872116:0:5876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832720.872119:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832720.872121:0:5876:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788832720.872123:0:5876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832720.872126:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832720.872127:0:5876:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788832720.872130:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832720.872136:0:5876:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000003f7a6073) 00000020:00000080:0.0:1788832720.872146:0:5876:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788832720.872150:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788832720.872152:0:5876:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788832720.872154:0:5876:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788832720.872161:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788832720.872201:0:5876:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004c6fd1a6 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788832720.872212:0:5876:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d5a8fd1c) 00000020:00000080:0.0:1788832720.872220:0:5876:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788832720.872262:0:5876:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788832720.872267:0:5876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd270a10c1c6a485b 00000020:00000080:0.0:1788832720.872361:0:5876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788832720.872367:0:5876:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788832720.872372:0:5876:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd270a10c1c6a4862 00080000:01000000:0.0:1788832720.872377:0:5876:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788832720.872387:0:5876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a4869 00080000:10000000:0.0:1788832720.872739:0:5876:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788832720.873182:0:5876:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788832720.878623:0:5876:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788832720.946152:0:5876:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788832720.946544:0:5876:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788832720.950146:0:5876:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788832720.950417:0:5876:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788832720.976291:0:5876:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000054a7a02e) 00000020:00000080:2.0:1788832720.976321:0:5876:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788832720.976398:0:5876:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788832720.976405:0:5876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a4877 00000020:00000080:0.0:1788832720.978996:0:5876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788832720.983029:0:5876:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788832721.013846:0:5876:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788832721.034678:0:5876:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788832721.057719:0:5876:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788832721.089889:0:5876:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788832721.121316:0:5876:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788832721.143409:0:5876:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd270a10c1c6a487e 00000020:00000080:1.0:1788832721.144090:0:5876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788832721.144101:0:5876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832721.144107:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832721.144109:0:5876:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788832721.144112:0:5876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832721.144115:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832721.144116:0:5876:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788832721.144119:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788832721.144120:0:5876:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788832721.144123:0:5876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832721.144124:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832721.144125:0:5876:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788832721.144127:0:5876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832721.144131:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832721.144132:0:5876:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788832721.144136:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788832721.144167:0:5876:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788832721.144215:0:5876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000093bc440d pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:5876:1875726994244864:0@lo:502: 00000100:00100000:1.0:1788832721.144294:0:5876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832721.144347:0:5876:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008c6fcb3 going to sleep for 11 seconds 00000100:00100000:3.0:1788832721.144404:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994244864 00000100:00100000:3.0:1788832721.144412:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994244864 00000100:00100000:3.0:1788832721.144459:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788832721.144466:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb09b348 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+9:5876:x1875726994244864:12345-0@lo:502: 00000100:00100000:3.0:1788832721.144793:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb09b348 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+9:5876:x1875726994244864:12345-0@lo:502: Request processed in 327us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832721.144801:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788832721.144903:0:5876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000093bc440d pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:5876:1875726994244864:0@lo:502: 00000020:01000000:1.0:1788832721.144927:0:5876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832721.144931:0:5876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832721.144933:0:5876:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788832721.144936:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788832721.145072:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788832721.145092:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788832721.145111:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: 000000005df2fd23/0xd270a10c1c6a4831 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4838 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.145121:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: 000000005df2fd23/0xd270a10c1c6a4831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4838 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832721.145128:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984d2a26c800 from 1 10000000:01000000:3.0:1788832721.145130:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788832721.145155:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.145163:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.145171:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832721.145185:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000deec1fa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994244992:0@lo:101: 00000100:00100000:3.0:1788832721.145214:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832721.145241:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000929b1b35 going to sleep for 11 seconds 00000100:00100000:3.0:1788832721.145259:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994244992 00000100:00100000:3.0:1788832721.145263:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994244992 00000100:00100000:3.0:1788832721.145293:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788832721.145299:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f786816c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+9:5834:x1875726994244992:12345-0@lo:101: 00010000:00010000:3.0:1788832721.145307:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832721.145318:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000142c2c1f/0xd270a10c1c6a488c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4885 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.145337:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000142c2c1f/0xd270a10c1c6a488c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4885 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.145345:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000142c2c1f/0xd270a10c1c6a488c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4885 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.145352:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000142c2c1f, rc 0) 00000100:00100000:3.0:1788832721.145379:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f786816c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+10:5834:x1875726994244992:12345-0@lo:101: Request processed in 81us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832721.145385:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788832721.145414:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000deec1fa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994244992:0@lo:101: 00010000:00010000:3.0:1788832721.145424:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a488c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.145431:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a488c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832721.146015:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000deec1fa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245120:0@lo:256: 00000100:00100000:3.0:1788832721.146051:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832721.146066:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000929b1b35 going to sleep for 11 seconds 00000100:00100000:3.0:1788832721.146083:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994245120 00000100:00100000:3.0:1788832721.146088:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994245120 00000100:00100000:3.0:1788832721.146112:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832721.146125:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0507679 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+10:5834:x1875726994245120:12345-0@lo:256: 20000000:01000000:3.0:1788832721.146139:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788832721.146144:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788832721.146201:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0507679 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+10:5834:x1875726994245120:12345-0@lo:256: Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832721.146207:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832721.146241:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000deec1fa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245120:0@lo:256: 10000000:01000000:3.0:1788832721.146856:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788832721.146864:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a488c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.146870:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a488c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832721.146877:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d2a26c800 from 1 10000000:01000000:3.0:1788832721.146879:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788832721.146897:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.146903:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.146911:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832721.146921:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000deec1fa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245248:0@lo:101: 00000100:00100000:3.0:1788832721.146950:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832721.146966:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000929b1b35 going to sleep for 11 seconds 00000100:00100000:3.0:1788832721.146983:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994245248 00000100:00100000:3.0:1788832721.146993:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994245248 00000100:00100000:3.0:1788832721.147017:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788832721.147023:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001745322c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+10:5834:x1875726994245248:12345-0@lo:101: 00010000:00010000:3.0:1788832721.147031:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832721.147041:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000249d96d/0xd270a10c1c6a489a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4893 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.147057:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000249d96d/0xd270a10c1c6a489a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4893 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.147065:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000249d96d/0xd270a10c1c6a489a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4893 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.147072:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000249d96d, rc 0) 00000100:00100000:3.0:1788832721.147101:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001745322c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+11:5834:x1875726994245248:12345-0@lo:101: Request processed in 78us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832721.147106:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788832721.147139:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000deec1fa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245248:0@lo:101: 00010000:00010000:3.0:1788832721.147149:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a489a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.147156:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a489a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832721.147193:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000deec1fa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245376:0@lo:501: 00000100:00100000:3.0:1788832721.147215:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832721.147227:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000929b1b35 going to sleep for 11 seconds 00000100:00100000:3.0:1788832721.147239:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994245376 00000100:00100000:3.0:1788832721.147243:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994245376 00000100:00100000:3.0:1788832721.147271:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788832721.147276:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000848ff0f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+11:5834:x1875726994245376:12345-0@lo:501: 00000100:00100000:3.0:1788832721.147770:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000848ff0f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+11:5834:x1875726994245376:12345-0@lo:501: Request processed in 493us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832721.147777:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788832721.147843:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000deec1fa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245376:0@lo:501: 00000100:00100000:3.0:1788832721.147868:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000deec1fa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245504:0@lo:503: 00000100:00100000:3.0:1788832721.148283:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832721.148315:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000929b1b35 going to sleep for 11 seconds 00000100:00100000:2.0:1788832721.148360:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994245504 00000100:00100000:2.0:1788832721.148365:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994245504 00000100:00100000:2.0:1788832721.148406:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788832721.148414:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7692ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+11:5834:x1875726994245504:12345-0@lo:503: 00000040:00080000:3.0:1788832721.149501:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788832721.149630:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7692ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+11:5834:x1875726994245504:12345-0@lo:503: Request processed in 1215us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832721.149638:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788832721.149705:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000deec1fa2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245504:0@lo:503: 00000040:00080000:2.0:1788832721.151023:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788832721.151216:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788832721.151238:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832721.151261:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a489a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832721.151272:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a489a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832721.151322:0:5834:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788832721.151324:0:5834:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984d2a26c800 10000000:01000000:0.0:1788832721.151327:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984d2a26c800 10000000:01000000:0.0:1788832721.151331:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832721.151336:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984d2a26c800 from 1 10000000:01000000:0.0:1788832721.151338:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788832721.151367:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: 0000000054233bc3/0xd270a10c1c6a48a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832721.151374:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: 0000000054233bc3/0xd270a10c1c6a48a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832721.151383:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: 0000000054233bc3/0xd270a10c1c6a48a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832721.151413:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e27e7af3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245632:0@lo:101: 00000100:00100000:0.0:1788832721.151463:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832721.151509:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1398baa going to sleep for 11 seconds 00000100:00100000:3.0:1788832721.151579:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994245632 00000100:00100000:3.0:1788832721.151587:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994245632 00000100:00100000:3.0:1788832721.151630:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788832721.151638:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095ff7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+11:5834:x1875726994245632:12345-0@lo:101: 00010000:00010000:3.0:1788832721.151649:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832721.151659:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002059185c/0xd270a10c1c6a48a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a48a1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.151678:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002059185c/0xd270a10c1c6a48a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a48a1 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.151688:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002059185c/0xd270a10c1c6a48a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a48a1 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.151695:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002059185c, rc 0) 00000100:00100000:3.0:1788832721.151736:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095ff7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:5834:x1875726994245632:12345-0@lo:101: Request processed in 99us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832721.151765:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788832721.151950:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e27e7af3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245632:0@lo:101: 00010000:00010000:0.0:1788832721.151961:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: 0000000054233bc3/0xd270a10c1c6a48a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a48a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832721.151969:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: 0000000054233bc3/0xd270a10c1c6a48a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a48a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832721.152011:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e27e7af3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245760:0@lo:501: 00000100:00100000:0.0:1788832721.152036:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832721.152065:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1398baa going to sleep for 11 seconds 00000100:00100000:3.0:1788832721.152110:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994245760 00000100:00100000:3.0:1788832721.152115:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994245760 00000100:00100000:3.0:1788832721.152145:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788832721.152151:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5804d73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:5834:x1875726994245760:12345-0@lo:501: 00000100:00100000:3.0:1788832721.152435:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5804d73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:5834:x1875726994245760:12345-0@lo:501: Request processed in 284us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832721.152442:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788832721.152608:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e27e7af3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245760:0@lo:501: 00000100:00100000:2.0:1788832721.152653:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbb0310b pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245888:0@lo:503: 00000100:00100000:2.0:1788832721.152692:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832721.153063:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994245888 00000100:00100000:0.0:1788832721.153068:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994245888 00000100:00100000:0.0:1788832721.153101:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788832721.153106:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098d5aded pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+12:5834:x1875726994245888:12345-0@lo:503: 00000100:00100000:0.0:1788832721.153383:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098d5aded pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+12:5834:x1875726994245888:12345-0@lo:503: Request processed in 277us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832721.153390:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788832721.153506:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aac20166 going to sleep for 11 seconds 00000100:00100000:1.0:1788832721.153533:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbb0310b pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994245888:0@lo:503: 00000100:00100000:2.0:1788832721.153991:0:5881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000481061fc pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:5881:1875726994246016:0@lo:502: 00000100:00100000:2.0:1788832721.154038:0:5881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832721.154104:0:5881:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021fba9a5 going to sleep for 11 seconds 00000100:00100000:0.0:1788832721.154139:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994246016 00000100:00100000:0.0:1788832721.154145:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994246016 00000100:00100000:0.0:1788832721.154211:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788832721.154217:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002440285d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:5881:x1875726994246016:12345-0@lo:502: 00000100:00100000:0.0:1788832721.154422:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002440285d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:5881:x1875726994246016:12345-0@lo:502: Request processed in 205us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832721.154438:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788832721.154507:0:5881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000481061fc pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:5881:1875726994246016:0@lo:502: 00000020:01000004:2.0:1788832721.154568:0:5881:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788832721.154582:0:5881:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000eaca4c2e) 00000020:00000080:2.0:1788832721.154599:0:5881:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788832721.154682:0:5881:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004c6fd1a6 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788832721.154687:0:5881:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004c6fd1a6 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788832721.154689:0:5881:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004c6fd1a6 4 00010000:00080000:2.0:1788832721.154714:0:5881:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f7297298@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.141@tcp at head 00010000:00010000:2.0:1788832721.156313:0:5881:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788832721.156501:0:5881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788832721.156545:0:5881:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788832721.156557:0:5881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd270a10c1c6a48b6 00000100:00080000:2.0:1788832721.156566:0:5881:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788832721.156571:0:5881:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f7297298 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:2.0:1788832721.156600:0:5881:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000481061fc x1875726994246144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788832721.156638:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000481061fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875726994246144:0@lo:38: 00000100:00100000:2.0:1788832721.156701:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788832721.156741:0:5881:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788832721.158483:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994246144 00000100:00100000:1.0:1788832721.158495:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994246144 00000100:00100000:1.0:1788832721.158546:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832721.158553:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875726994246144:12345-0@lo:38: 00000100:00100000:1.0:1788832721.158632:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875726994246144:12345-0@lo:38: Request processed in 78us (1931us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788832721.158639:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832721.158697:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788832721.158705:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000f7297298 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788832721.158709:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788832721.158712:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000481061fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875726994246144:0@lo:38: 00000100:00100000:3.0:1788832721.159078:0:5881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fc37e31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:5881:1875726994246272:0@lo:502: 00000100:00100000:3.0:1788832721.159128:0:5881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832721.159153:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994246272 00000100:00100000:3.0:1788832721.159157:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994246272 00000100:00100000:3.0:1788832721.159183:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788832721.159189:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5380308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:5881:x1875726994246272:12345-0@lo:502: 00000100:00100000:3.0:1788832721.159371:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5380308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:5881:x1875726994246272:12345-0@lo:502: Request processed in 182us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832721.159378:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788832721.159470:0:5881:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf8291c9 going to sleep for 11 seconds 00000100:00100000:3.0:1788832721.159484:0:5881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fc37e31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:5881:1875726994246272:0@lo:502: 00000040:00080000:3.0:1788832721.159506:0:5881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788832721.159712:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788832721.159736:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788832721.159928:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: 0000000054233bc3/0xd270a10c1c6a48a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a48a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832721.159938:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: 0000000054233bc3/0xd270a10c1c6a48a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a48a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788832721.159991:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788832721.159993:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788832721.159994:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832721.159995:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832721.159997:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832721.159998:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832721.160000:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788832721.160001:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788832721.160002:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832721.160004:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832721.160005:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832721.160006:0:5834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788832721.160009:0:5834:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788832721.160012:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788832721.160013:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788832721.160014:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832721.160015:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832721.160016:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832721.160017:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832721.160018:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788832721.160019:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788832721.160020:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832721.160021:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832721.160021:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832721.160022:0:5834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788832721.160037:0:5834:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788832721.160046:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000093bc440d pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994246400:0@lo:253: 00000100:00100000:1.0:1788832721.160083:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832721.160110:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008c6fcb3 going to sleep for 11 seconds 00000100:00100000:0.0:1788832721.160937:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994246400 00000100:00100000:0.0:1788832721.160945:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994246400 00000100:00100000:0.0:1788832721.160979:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788832721.160987:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f39fec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:5834:x1875726994246400:12345-0@lo:253: 20000000:01000000:0.0:1788832721.161011:0:5846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788832721.161022:0:5846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788832721.184814:0:5846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788832721.184830:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788832721.185066:0:5869:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788832721.185071:0:5869:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788832721.185088:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185104:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000142c2c1f/0xd270a10c1c6a488c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4885 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185123:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185156:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000142c2c1f/0xd270a10c1c6a488c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4885 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185168:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000142c2c1f/0xd270a10c1c6a488c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4885 expref: 12 pid: 5848 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832721.185182:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fc37e31 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5869:1875726994246528:0@lo:104: 00000100:00100000:3.0:1788832721.185238:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832721.185284:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 00000000721b4708 going to sleep for 11 seconds 00000100:00100000:3.0:1788832721.185315:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994246528 00000100:00100000:3.0:1788832721.185321:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994246528 00000100:00100000:3.0:1788832721.185361:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832721.185369:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efd23661 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:5869:x1875726994246528:12345-0@lo:104: 00010000:00010000:3.0:1788832721.185379:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a488c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185427:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788832721.185432:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efd23661 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:5869:x1875726994246528:12345-0@lo:104: Request processed in 65us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832721.185439:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788832721.185461:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832721.185465:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a488c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185472:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000016e9d8c5 already unused, calling callback (00000000cdcbc805) 10000000:00010000:3.0:1788832721.185480:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a488c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185488:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a488c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832721.185495:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a488c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832721.185501:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832721.185537:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a488c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185543:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832721.185557:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a488c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185562:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: 0000000016e9d8c5/0xd270a10c1c6a4885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a488c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185576:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832721.185577:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832721.185578:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832721.185625:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d1b758d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994246656:0@lo:103: 00000100:00100000:3.0:1788832721.185652:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832721.185727:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994246656 00000100:00100000:3.0:1788832721.185732:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994246656 00010000:00010000:3.0:1788832721.185773:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000142c2c1f/0xd270a10c1c6a488c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4885 expref: 13 pid: 5848 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832721.185808:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832721.185820:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093acdc28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+13:3315:x1875726994246656:12345-0@lo:103: 00010000:00010000:3.0:1788832721.185830:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832721.185834:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000142c2c1f/0xd270a10c1c6a488c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4885 expref: 13 pid: 5848 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185842:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000142c2c1f/0xd270a10c1c6a488c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4885 expref: 13 pid: 5848 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185855:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185862:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788832721.185872:0:5838:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000802150s 00010000:00010000:3.0:1788832721.185875:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185881:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185886:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185892:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185897:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000088c5e72c already unused, calling callback (000000009fba8ae1) 00010000:00010000:3.0:1788832721.185900:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185906:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185921:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.185930:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832721.185959:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093acdc28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+13:3315:x1875726994246656:12345-0@lo:103: Request processed in 140us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832721.185966:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832721.185999:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d1b758d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994246656:0@lo:103: 00010000:00010000:3.0:1788832721.186024:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000142c2c1f/0xd270a10c1c6a488c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4885 expref: 12 pid: 5848 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832721.186032:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fc37e31 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5869:1875726994246528:0@lo:104: 00010000:00010000:3.0:1788832721.186042:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.186049:0:5869:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.186053:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832721.186059:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000088c5e72c/0xd270a10c1c6a48bd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832721.195436:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f39fec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+11:5834:x1875726994246400:12345-0@lo:253: Request processed in 34442us (35345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832721.195451:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788832721.195626:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000093bc440d pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:5834:1875726994246400:0@lo:253: 10000000:01000000:1.0:1788832721.195641:0:5834:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788832721.195644:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788832721.195646:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788832721.195647:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832721.195648:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832721.195658:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832721.195660:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832721.195661:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788832721.195663:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788832721.195664:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832721.195665:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832721.195667:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832721.195668:0:5834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788832721.195682:0:5834:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788832721.200627:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788832721.201439:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788832721.201681:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788832721.202105:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788832721.202316:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788832721.202535:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788832721.203388:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788832721.203610:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788832721.203951:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788832721.204151:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788832721.204350:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788832721.204566:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788832721.243217:0:5834:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788832721.272954:0:5834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788832721.273117:0:5886:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788832721.273121:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788832721.273246:0:5887:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788832721.275966:0:5834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788832721.276142:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788832721.276573:0:5834:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788832721.276580:0:5834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788832721.276705:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832721.280633:0:5834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788832721.282299:0:5834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788832721.282354:0:5834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788832721.282713:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788832721.284314:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788832721.288576:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788832721.288727:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788832721.292309:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788832721.292489:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788832721.292642:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788832721.295430:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788832721.295648:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788832721.297387:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788832721.297572:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788832721.297716:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788832721.298009:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788832721.298158:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788832721.298300:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788832721.298448:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788832721.298621:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788832721.299061:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788832721.299357:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788832721.299535:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788832721.299693:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788832721.299883:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788832721.300018:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788832721.300166:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788832721.301597:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788832721.301927:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788832721.302100:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788832721.302255:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788832721.302725:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788832721.303148:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788832721.303377:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788832721.303540:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788832721.303667:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788832721.305178:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788832721.305609:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788832721.357862:0:5887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788832721.400677:0:5834:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788832721.400712:0:5834:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae0441b93988 00100000:10000000:0.0:1788832721.400720:0:5834:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788832721.406792:0:5834:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788832721.406807:0:5834:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.141@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788832721.406819:0:5834:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788832721.406841:0:5834:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788832721.467267:0:5887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788832721.467341:0:5887:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788832721.467345:0:5887:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788832721.495092:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832722.517947:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832723.542580:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832724.566805:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832725.591522:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788832725.826108:0:6130:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1788832726.165975:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788832726.165983:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788832726.165986:0:38:0:(import.c:65:import_set_state_nolock()) 00000000f7297298 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832726.165998:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f7297298 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:0.0:1788832726.166019:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003182ed05 x1875726994246912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788832726.166052:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003182ed05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875726994246912:0@lo:38: 00000100:00100000:0.0:1788832726.166116:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832726.166211:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994246912 00000100:00100000:1.0:1788832726.166219:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994246912 00000100:00100000:1.0:1788832726.166261:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832726.166267:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003680f83b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875726994246912:12345-0@lo:38: 00010000:00080000:1.0:1788832726.166290:0:5855:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:1.0:1788832726.166324:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd270a10c1c6a48c4 00000004:00100000:1.0:1788832726.166362:0:5855:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788832726.166499:0:5855:0:(import.c:65:import_set_state_nolock()) 000000004959932c : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832726.166532:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000df023dd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994246784:0@lo:400: 00000100:00100000:1.0:1788832726.166557:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003680f83b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875726994246912:12345-0@lo:38: Request processed in 288us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832726.166572:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788832726.166580:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788832726.166962:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003182ed05 x1875726994246912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788832726.166988:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788832726.166994:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788832726.166998:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788832726.167000:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000f7297298 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788832726.167005:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003182ed05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875726994246912:0@lo:38: 00000100:00100000:0.0:1788832726.167029:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994246784 00000100:00100000:0.0:1788832726.167033:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994246784 00000100:00100000:0.0:1788832726.167069:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788832726.167076:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a273a9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+11:3316:x1875726994246784:12345-0@lo:400: 00000100:00100000:0.0:1788832726.167117:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a273a9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+11:3316:x1875726994246784:12345-0@lo:400: Request processed in 41us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832726.167123:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788832726.167155:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000df023dd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994246784:0@lo:400: 00010000:00010000:2.0:1788832726.617431:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788832726.680451:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788832726.680458:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984d2a26c800 from 3 10000000:01000000:2.0:1788832726.680462:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788832726.680511:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: 00000000ad15cebc/0xd270a10c1c6a48cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832726.680523:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: 00000000ad15cebc/0xd270a10c1c6a48cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832726.680532:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: 00000000ad15cebc/0xd270a10c1c6a48cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832726.680552:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083267a22 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994247040:0@lo:101: 00000100:00100000:2.0:1788832726.680613:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832726.680675:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 000000009de528d1 going to sleep for 11 seconds 00000100:00100000:3.0:1788832726.682795:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994247040 00000100:00100000:3.0:1788832726.682808:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994247040 00000100:00100000:3.0:1788832726.682856:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788832726.682864:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5518b64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+11:5850:x1875726994247040:12345-0@lo:101: 00010000:00010000:3.0:1788832726.682879:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832726.682895:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000142c2c1f/0xd270a10c1c6a48d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a48cb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832726.682920:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000142c2c1f/0xd270a10c1c6a48d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a48cb expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832726.682930:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000142c2c1f/0xd270a10c1c6a48d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a48cb expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832726.682937:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000142c2c1f, rc 0) 00000100:00100000:3.0:1788832726.682999:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5518b64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:5850:x1875726994247040:12345-0@lo:101: Request processed in 136us (2386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832726.683005:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788832726.683056:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083267a22 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994247040:0@lo:101: 00010000:00010000:3.0:1788832726.683071:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: 00000000ad15cebc/0xd270a10c1c6a48cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a48d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832726.683080:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: 00000000ad15cebc/0xd270a10c1c6a48cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a48d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832726.683139:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fc37e31 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994247168:0@lo:256: 00000100:00100000:3.0:1788832726.683182:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832726.683216:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d8245a2 going to sleep for 11 seconds 00000100:00100000:2.0:1788832726.684117:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994247168 00000100:00100000:2.0:1788832726.684125:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994247168 00000100:00100000:2.0:1788832726.684177:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788832726.684185:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ec1c3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:5850:x1875726994247168:12345-0@lo:256: 20000000:01000000:2.0:1788832726.684202:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788832726.684218:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788832726.684221:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788832726.684318:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ec1c3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:5850:x1875726994247168:12345-0@lo:256: Request processed in 123us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832726.684326:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788832726.684453:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fc37e31 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994247168:0@lo:256: 10000000:01000000:3.0:1788832726.684512:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788832726.684519:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: 00000000ad15cebc/0xd270a10c1c6a48cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a48d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832726.684527:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: 00000000ad15cebc/0xd270a10c1c6a48cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a48d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832727.637980:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832728.662559:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832729.694699:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788832730.502731:0:6331:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd43cff50 20000000:00000080:0.0:1788832730.502955:0:6331:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984d3de9f800 uarg=0000000000000000 20000000:01000000:0.0:1788832730.502999:0:6331:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788832730.503005:0:6331:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788832730.503010:0:6331:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788832730.503219:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788832730.503229:0:6331:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788832730.523567:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832730.526185:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788832730.526266:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788832730.526315:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788832730.526334:0:6331:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788832730.526352:0:6331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832730.526369:0:6331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000249d96d/0xd270a10c1c6a489a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4893 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832730.526377:0:6331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832730.526414:0:6331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000249d96d/0xd270a10c1c6a489a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4893 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832730.526428:0:6331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000249d96d/0xd270a10c1c6a489a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4893 expref: 11 pid: 5847 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832730.526441:0:6331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036048e3c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1875726994247296:0@lo:104: 00000100:00100000:2.0:1788832730.526522:0:6331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832730.526585:0:6331:0:(client.c:2715:ptlrpc_set_wait()) set 000000009de528d1 going to sleep for 11 seconds 00000100:00100000:3.0:1788832730.526697:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994247296 00000100:00100000:3.0:1788832730.526705:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994247296 00000100:00100000:3.0:1788832730.526794:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832730.526803:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f9b0b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:6331:x1875726994247296:12345-0@lo:104: 00010000:00010000:3.0:1788832730.526814:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a489a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832730.526872:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788832730.526877:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f9b0b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:6331:x1875726994247296:12345-0@lo:104: Request processed in 77us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832730.526884:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788832730.526946:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832730.526951:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a489a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832730.526969:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006d847dc7 already unused, calling callback (00000000cdcbc805) 10000000:00010000:0.0:1788832730.526972:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a489a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832730.526986:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a489a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832730.526992:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a489a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832730.526997:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788832730.527032:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a489a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832730.527039:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832730.527055:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a489a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832730.527061:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: 000000006d847dc7/0xd270a10c1c6a4893 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a489a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832730.527078:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832730.527079:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832730.527081:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832730.527087:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832730.527097:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000df023dd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994247424:0@lo:103: 00000100:00100000:0.0:1788832730.527125:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832730.527325:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994247424 00000100:00100000:3.0:1788832730.527330:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994247424 00010000:00010000:3.0:1788832730.527345:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000249d96d/0xd270a10c1c6a489a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4893 expref: 12 pid: 5847 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832730.527374:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832730.527380:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003182ed05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+12:3316:x1875726994247424:12345-0@lo:103: 00010000:00010000:3.0:1788832730.527399:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832730.527403:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000249d96d/0xd270a10c1c6a489a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4893 expref: 12 pid: 5847 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832730.527412:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000249d96d/0xd270a10c1c6a489a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4893 expref: 12 pid: 5847 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832730.527425:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832730.527432:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832730.527444:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832730.527451:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832730.527456:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832730.527461:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832730.527478:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000026c69f82 already unused, calling callback (000000009fba8ae1) 00010000:00010000:3.0:1788832730.527481:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832730.527487:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832730.527506:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832730.527516:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832730.527558:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003182ed05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+12:3316:x1875726994247424:12345-0@lo:103: Request processed in 178us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832730.527564:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832730.527639:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000df023dd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994247424:0@lo:103: 00010000:00010000:2.0:1788832730.528313:0:6331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000249d96d/0xd270a10c1c6a489a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4893 expref: 11 pid: 5847 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832730.528327:0:6331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036048e3c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1875726994247296:0@lo:104: 00010000:00010000:2.0:1788832730.528343:0:6331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832730.528351:0:6331:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832730.528366:0:6331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832730.528371:0:6331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000026c69f82/0xd270a10c1c6a48d9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832730.713453:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832731.292064:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832731.292087:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036048e3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994247552:0@lo:400: 00000100:00100000:2.0:1788832731.292360:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832731.296485:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994247552 00000100:00100000:1.0:1788832731.296501:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994247552 00000100:00100000:1.0:1788832731.296562:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832731.296570:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030df4b33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994247552:12345-0@lo:400: 00000100:00100000:1.0:1788832731.296664:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030df4b33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994247552:12345-0@lo:400: Request processed in 95us (4305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832731.296671:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788832731.298222:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000036048e3c x1875726994247552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832731.298239:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036048e3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994247552:0@lo:400: 00010000:00010000:0.0:1788832731.733914:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832732.758894:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832733.781965:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832734.810072:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788832735.383465:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788832735.383472:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d2a26c800 from 1 10000000:01000000:1.0:1788832735.383477:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788832735.383521:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: 00000000ea515a93/0xd270a10c1c6a48e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832735.383534:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: 00000000ea515a93/0xd270a10c1c6a48e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832735.383543:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: 00000000ea515a93/0xd270a10c1c6a48e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832735.383564:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000093bc440d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994247680:0@lo:101: 00000100:00100000:1.0:1788832735.383620:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832735.383720:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 000000007733adbe going to sleep for 11 seconds 00000100:00100000:2.0:1788832735.386919:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994247680 00000100:00100000:2.0:1788832735.386932:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994247680 00000100:00100000:2.0:1788832735.387017:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832735.387025:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000788c10b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+11:5850:x1875726994247680:12345-0@lo:101: 00010000:00010000:2.0:1788832735.387040:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832735.387054:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000052fea27/0xd270a10c1c6a48e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a48e0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832735.387075:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000052fea27/0xd270a10c1c6a48e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a48e0 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832735.387085:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000052fea27/0xd270a10c1c6a48e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a48e0 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832735.387093:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000052fea27, rc 0) 00000100:00100000:2.0:1788832735.387157:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000788c10b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:5850:x1875726994247680:12345-0@lo:101: Request processed in 134us (3538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832735.387164:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788832735.387342:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000093bc440d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994247680:0@lo:101: 00010000:00010000:1.0:1788832735.387369:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: 00000000ea515a93/0xd270a10c1c6a48e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a48e7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832735.387388:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: 00000000ea515a93/0xd270a10c1c6a48e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a48e7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832735.387454:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000093bc440d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994247808:0@lo:501: 00000100:00100000:1.0:1788832735.387484:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832735.387623:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 000000007733adbe going to sleep for 11 seconds 00000100:00100000:3.0:1788832735.387698:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994247808 00000100:00100000:3.0:1788832735.387712:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994247808 00000100:00100000:3.0:1788832735.387735:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788832735.387776:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c8a9819 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:5850:x1875726994247808:12345-0@lo:501: 00000100:00100000:3.0:1788832735.387996:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c8a9819 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:5850:x1875726994247808:12345-0@lo:501: Request processed in 255us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832735.388003:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788832735.388029:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000093bc440d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994247808:0@lo:501: 00000100:00100000:3.0:1788832735.388052:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fc37e31 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994247936:0@lo:503: 00000100:00100000:3.0:1788832735.388086:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832735.388099:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 00000000264694d5 going to sleep for 11 seconds 00000100:00100000:3.0:1788832735.388109:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994247936 00000100:00100000:3.0:1788832735.388112:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994247936 00000100:00100000:3.0:1788832735.388127:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788832735.388132:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2fee32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:5850:x1875726994247936:12345-0@lo:503: 00000100:00100000:3.0:1788832735.388323:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2fee32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:5850:x1875726994247936:12345-0@lo:503: Request processed in 191us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832735.388329:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788832735.388593:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fc37e31 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994247936:0@lo:503: 00000100:00100000:3.0:1788832735.388967:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fc37e31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:6662:1875726994248064:0@lo:502: 00000100:00100000:3.0:1788832735.389004:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832735.389027:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set 000000001f19db89 going to sleep for 11 seconds 00000100:00100000:1.0:1788832735.389067:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994248064 00000100:00100000:1.0:1788832735.389072:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994248064 00000100:00100000:1.0:1788832735.389094:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788832735.389098:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000646594e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:6662:x1875726994248064:12345-0@lo:502: 00000100:00100000:1.0:1788832735.389251:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000646594e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:6662:x1875726994248064:12345-0@lo:502: Request processed in 152us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832735.389257:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788832735.389317:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fc37e31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:6662:1875726994248064:0@lo:502: 00000020:01000000:3.0:1788832735.389336:0:6662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832735.389344:0:6662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832735.389346:0:6662:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788832735.389352:0:6662:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984d2a26c800 00000020:00000080:3.0:1788832735.389354:0:6662:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788832735.389396:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:6662:1875726994248192:0@lo:502: 00000100:00100000:3.0:1788832735.389423:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832735.389451:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18d71600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832735.389541:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994248192 00000100:00100000:1.0:1788832735.389546:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994248192 00000100:00100000:1.0:1788832735.389563:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788832735.389568:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:6662:x1875726994248192:12345-0@lo:502: 00000100:00100000:1.0:1788832735.389677:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:6662:x1875726994248192:12345-0@lo:502: Request processed in 107us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832735.389683:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788832735.389930:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:6662:1875726994248192:0@lo:502: 00000020:01000000:3.0:1788832735.389949:0:6662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832735.389954:0:6662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832735.389956:0:6662:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788832735.389959:0:6662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788832735.390077:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788832735.390093:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788832735.390101:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f04c00/0xd270a10c1c6a48e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a48e7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832735.390111:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d05f04c00/0xd270a10c1c6a48e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a48e7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832735.833208:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788832736.355304:0:6696:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788832736.355308:0:6696:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788832736.355428:0:6696:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff984d39f1a000 00000020:01000004:0.0:1788832736.355457:0:6696:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788832736.355468:0:6696:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788832736.355488:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff984d20343370) 00000020:00000080:0.0:1788832736.355501:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788832736.390803:0:6696:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788832736.391551:0:6696:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00000100:00100000:3.0:1788832736.407267:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994248320:0@lo:400: 00000100:00100000:3.0:1788832736.407333:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832736.409299:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994248320 00000100:00100000:2.0:1788832736.409317:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994248320 00000100:00100000:2.0:1788832736.409368:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788832736.409377:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:3315:x1875726994248320:12345-0@lo:400: 00000100:00100000:1.0:1788832736.410504:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994248448:0@lo:400: 00000100:00100000:1.0:1788832736.410551:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832736.411596:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994248320:0@lo:400: 00000100:00100000:0.0:1788832736.413403:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994248448 00000100:00100000:0.0:1788832736.413412:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994248448 00000100:00100000:0.0:1788832736.413478:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832736.413490:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994248448:12345-0@lo:400: 00000100:00100000:2.0:1788832736.417358:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:3315:x1875726994248320:12345-0@lo:400: Request processed in 7977us (10018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832736.417423:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994248448:12345-0@lo:400: Request processed in 3925us (6860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832736.417445:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788832736.417491:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff984d3989ea00 x1875726994248448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832736.417519:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994248448:0@lo:400: 00000100:00100000:2.0:1788832736.418462:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00100000:10000000:1.0:1788832736.420663:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788832736.426166:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788832736.426200:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788832736.426251:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788832736.426275:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788832736.426689:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788832736.426842:0:6696:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788832736.426854:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd270a10c1c6a48f5 00000020:01000004:1.0:1788832736.426861:0:6696:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788832736.426880:0:6696:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.141@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788832736.426884:0:6696:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788832736.426889:0:6696:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788832736.426893:0:6696:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788832736.426904:0:6696:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff984d064819b8) 00000020:00000080:1.0:1788832736.426914:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1788832736.428093:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832736.428254:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788832736.428260:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788832736.429381:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788832736.429389:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788832736.429961:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788832736.429968:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788832736.431563:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832736.432506:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788832736.432520:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788832736.439227:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788832736.439239:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788832736.460895:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832736.461170:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788832736.461177:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788832736.462330:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788832736.462339:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788832736.463628:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788832736.463639:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788832736.466469:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832736.466666:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788832736.466673:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788832736.467921:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788832736.467930:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788832736.538413:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832736.539419:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788832736.539426:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788832736.541880:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788832736.541903:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788832736.542724:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788832736.542777:0:6696:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788832736.542783:0:6696:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.141@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788832736.572113:0:6696:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.141@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788832736.572148:0:6696:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.141@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788832736.572152:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788832736.572154:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788832736.572155:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832736.572156:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832736.572157:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832736.572158:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832736.572160:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832736.572161:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788832736.572162:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788832736.572164:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832736.572165:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788832736.572168:0:6696:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788832736.572171:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788832736.572172:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788832736.572173:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832736.572174:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832736.572176:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832736.572177:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832736.572177:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832736.572179:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788832736.572179:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788832736.572181:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832736.572182:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788832736.572215:0:6696:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788832736.572232:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994248576:0@lo:253: 00000100:00100000:3.0:1788832736.572298:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832736.572368:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832736.572445:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994248576 00000100:00100000:0.0:1788832736.572454:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994248576 00000100:00100000:0.0:1788832736.572509:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788832736.572519:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+12:6696:x1875726994248576:12345-0@lo:253: 20000000:01000000:0.0:1788832736.572547:0:5848:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788832736.572551:0:5848:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788832736.572557:0:5848:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788832736.572560:0:5848:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788832736.573992:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832736.574461:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788832736.574476:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788832736.574515:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788832736.574523:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788832736.574556:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788832736.574609:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788832736.574999:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788832736.575020:0:5848:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.141@tcp 20000000:01000000:0.0:1788832736.575022:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.141@tcp (null) (null) (null) 00000040:00080000:0.0:1788832736.575058:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788832736.575067:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788832736.575317:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788832736.575328:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.141@tcp (null) (null) 00000040:00080000:0.0:1788832736.575445:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788832736.575455:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788832736.575486:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788832736.575531:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788832736.576545:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788832736.576565:0:5848:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.141@tcp 20000000:01000000:0.0:1788832736.576568:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.141@tcp (null) (null) (null) 00000040:00080000:0.0:1788832736.576601:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788832736.576608:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788832736.576635:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788832736.576642:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.141@tcp (null) (null) 00000040:00080000:0.0:1788832736.576687:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788832736.576697:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788832736.577277:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788832736.577309:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788832736.577325:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788832736.577327:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788832736.577333:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788832736.577335:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788832736.577337:0:5848:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788832736.577347:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788832736.577395:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788832736.577429:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788832736.577431:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788832736.578061:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788832736.578141:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788832736.578213:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788832736.578478:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788832736.578521:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788832736.578596:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788832736.578610:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788832736.578612:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788832736.579224:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788832736.579277:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788832736.579341:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788832736.579640:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788832736.579680:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788832736.579728:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788832736.579740:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788832736.579773:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788832736.580338:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788832736.580564:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788832736.580602:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788832736.580657:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:3.0:1788832736.580675:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788832736.580693:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.580723:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d05f05400/0xd270a10c1c6a481c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4815 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.580731:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d027e3400/0xd270a10c1c6a4838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4831 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.580738:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a48a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a48a1 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.580871:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.580976:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a48a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a48a1 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.580990:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a48a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a48a1 expref: 12 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.581003:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994248704:0@lo:104: 00000100:00100000:0.0:1788832736.581055:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832736.581133:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d027e3400/0xd270a10c1c6a4838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4831 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.581141:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d027e3400/0xd270a10c1c6a4838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4831 expref: 12 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.581149:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994248832:0@lo:104: 00000100:00100000:0.0:1788832736.581169:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832736.581191:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d05f05400/0xd270a10c1c6a481c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4815 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.581199:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d05f05400/0xd270a10c1c6a481c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4815 expref: 12 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.581207:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994248960:0@lo:104: 00000100:00100000:0.0:1788832736.581224:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832736.581233:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03cc5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832736.581337:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994248704 00000100:00100000:1.0:1788832736.581344:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994248704 00000100:00100000:1.0:1788832736.581385:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994248832 00000100:00100000:1.0:1788832736.581388:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994248832 00000100:00100000:1.0:1788832736.581396:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994248960 00000100:00100000:1.0:1788832736.581398:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994248960 00000100:00100000:1.0:1788832736.581409:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832736.581417:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+5:5848:x1875726994248704:12345-0@lo:104: 00010000:00010000:1.0:1788832736.581428:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a48a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a48a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832736.581492:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832736.581499:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+5:5848:x1875726994248704:12345-0@lo:104: Request processed in 82us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832736.581505:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832736.581520:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832736.581526:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+4:5848:x1875726994248832:12345-0@lo:104: 00010000:00010000:1.0:1788832736.581533:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d027e3000/0xd270a10c1c6a4831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4838 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832736.581560:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788832736.581565:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+4:5848:x1875726994248832:12345-0@lo:104: Request processed in 39us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832736.581577:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832736.581589:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788832736.581594:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:5848:x1875726994248960:12345-0@lo:104: 00010000:00010000:1.0:1788832736.581601:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a481c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832736.581626:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788832736.581631:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:5848:x1875726994248960:12345-0@lo:104: Request processed in 37us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832736.581636:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788832736.581938:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788832736.581945:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a48a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a48a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.581959:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d00031600 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788832736.581963:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a48a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a48a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.581971:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a48a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a48a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832736.581978:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a48a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a48a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832736.581984:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832736.582016:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a48a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a48a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582023:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832736.582047:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a48a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a48a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582055:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a48a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a48a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582072:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788832736.582075:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d027e3000/0xd270a10c1c6a4831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4838 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582082:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d027e3000 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788832736.582085:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3000/0xd270a10c1c6a4831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4838 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582113:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d027e3000/0xd270a10c1c6a4831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4838 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832736.582119:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3000/0xd270a10c1c6a4831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4838 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832736.582189:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832736.582205:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d027e3000/0xd270a10c1c6a4831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4838 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582211:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832736.582226:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d027e3000/0xd270a10c1c6a4831 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4838 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582232:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d027e3000/0xd270a10c1c6a4831 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4838 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582243:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832736.582246:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a481c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582251:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d00030c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788832736.582254:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a481c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582260:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a481c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832736.582266:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a481c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832736.582278:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832736.582291:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a481c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582296:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832736.582303:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4815 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a481c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582309:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a481c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582322:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832736.582323:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832736.582325:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832736.582332:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832736.582337:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832736.582347:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994249088:0@lo:103: 00000100:00100000:0.0:1788832736.582378:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832736.582423:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994249216:0@lo:103: 00000100:00100000:0.0:1788832736.582455:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832736.582474:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832736.582479:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994249344:0@lo:103: 00000100:00100000:0.0:1788832736.582497:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832736.582523:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994249088 00000100:00100000:0.0:1788832736.582527:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994249088 00010000:00010000:0.0:1788832736.582548:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a48a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a48a1 expref: 13 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.582562:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994249216 00000100:00100000:0.0:1788832736.582571:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994249216 00010000:00010000:0.0:1788832736.582583:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d027e3400/0xd270a10c1c6a4838 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4831 expref: 14 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.582594:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994249344 00000100:00100000:0.0:1788832736.582596:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994249344 00010000:00010000:0.0:1788832736.582604:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d05f05400/0xd270a10c1c6a481c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4815 expref: 15 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.582615:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788832736.582621:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+15:3316:x1875726994249088:12345-0@lo:103: 00010000:00010000:0.0:1788832736.582629:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832736.582633:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a48a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a48a1 expref: 15 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582643:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a48a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a48a1 expref: 15 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.582657:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832736.582685:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+15:3316:x1875726994249088:12345-0@lo:103: Request processed in 64us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832736.582692:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788832736.583109:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832736.583118:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+14:3314:x1875726994249216:12345-0@lo:103: 00010000:00010000:0.0:1788832736.583135:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832736.583140:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d027e3400/0xd270a10c1c6a4838 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4831 expref: 14 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583150:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d027e3400/0xd270a10c1c6a4838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4831 expref: 14 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583172:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832736.583212:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+14:3314:x1875726994249216:12345-0@lo:103: Request processed in 96us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832736.583219:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832736.583232:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832736.583238:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+13:3314:x1875726994249344:12345-0@lo:103: 00010000:00010000:0.0:1788832736.583245:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832736.583249:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d05f05400/0xd270a10c1c6a481c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4815 expref: 13 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583258:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d05f05400/0xd270a10c1c6a481c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4815 expref: 13 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583268:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583276:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583289:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583296:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583302:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583309:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583321:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d027e2e00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:0.0:1788832736.583325:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583332:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583341:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583352:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832736.583376:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+13:3314:x1875726994249344:12345-0@lo:103: Request processed in 138us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832736.583382:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832736.583419:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994249088:0@lo:103: 00010000:00010000:0.0:1788832736.583462:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a48a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a48a1 expref: 12 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.583474:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994248704:0@lo:104: 00010000:00010000:0.0:1788832736.583484:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e3400/0xd270a10c1c6a4838 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4831 expref: 11 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.583491:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994248832:0@lo:104: 00010000:00010000:0.0:1788832736.583499:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d05f05400/0xd270a10c1c6a481c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4815 expref: 10 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.583508:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994248960:0@lo:104: 00010000:00010000:0.0:1788832736.583536:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583544:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583551:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.583557:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4903 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788832736.583570:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788832736.583961:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994249344:0@lo:103: 00000100:00100000:2.0:1788832736.583969:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994249216:0@lo:103: 00000100:00100000:3.0:1788832736.647467:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+9:6696:x1875726994248576:12345-0@lo:253: Request processed in 74942us (75161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832736.647482:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788832736.647564:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994248576:0@lo:253: 10000000:01000000:1.0:1788832736.647578:0:6696:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788832736.647581:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788832736.647583:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788832736.647584:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832736.647585:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788832736.647586:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832736.647588:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832736.647589:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788832736.647590:0:6696:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788832736.647592:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832736.647593:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788832736.647615:0:6696:0:(tgt_mount.c:101:server_register_mount()) register mount ffff984d39f1a000 from lustre-OST0000 10000000:01000000:1.0:1788832736.647659:0:6696:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788832736.647662:0:6696:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788832736.647668:0:6696:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff984d06434d28 local copy 10000000:01000000:1.0:1788832736.647671:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788832736.647973:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.647985:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.647995:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.648013:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994249472:0@lo:101: 00000100:00100000:0.0:1788832736.648050:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832736.648153:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03cc5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788832736.648243:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994249472 00000100:00100000:2.0:1788832736.648249:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994249472 00000100:00100000:2.0:1788832736.648328:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788832736.648337:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+9:6696:x1875726994249472:12345-0@lo:101: 00010000:00010000:2.0:1788832736.648348:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832736.648361:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d013d1000/0xd270a10c1c6a4911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a490a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832736.648381:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d1000/0xd270a10c1c6a4911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a490a expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832736.648401:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d013d1000/0xd270a10c1c6a4911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a490a expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832736.648409:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d013d1000, rc 0) 00000100:00100000:2.0:1788832736.648459:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+10:6696:x1875726994249472:12345-0@lo:101: Request processed in 123us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832736.648465:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788832736.648534:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994249472:0@lo:101: 00010000:00010000:0.0:1788832736.648547:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd270a10c1c6a4911 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.648556:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd270a10c1c6a4911 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.648657:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994249600:0@lo:501: 00000100:00100000:0.0:1788832736.648682:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832736.648856:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03cc5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832736.648992:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994249600 00000100:00100000:3.0:1788832736.648998:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994249600 00000100:00100000:3.0:1788832736.649022:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788832736.649035:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+10:6696:x1875726994249600:12345-0@lo:501: 00000100:00100000:3.0:1788832736.649244:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+10:6696:x1875726994249600:12345-0@lo:501: Request processed in 209us (560us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788832736.649252:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788832736.649334:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994249600:0@lo:501: 10000000:01000000:0.0:1788832736.649351:0:6696:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788832736.649374:0:6696:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788832736.649379:0:6696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd270a10c1c6a4911 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.649388:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd270a10c1c6a4911 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.649395:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd270a10c1c6a4911 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.649419:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788832736.649444:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984d39f1a000 10000000:01000000:0.0:1788832736.649449:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788832736.649453:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff984d06434d28 10000000:01000000:0.0:1788832736.649455:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788832736.649458:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff984d06434d28 from 1 10000000:01000000:0.0:1788832736.649460:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788832736.649478:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a4918 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.649486:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a4918 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.649504:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a4918 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.649517:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994249728:0@lo:101: 00000100:00100000:0.0:1788832736.649543:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832736.649555:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03cc5240 going to sleep for 11 seconds 00010000:00010000:3.0:1788832736.649607:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832736.649613:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd270a10c1c6a4911 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.649621:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d00030c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1788832736.649624:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd270a10c1c6a4911 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.649633:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd270a10c1c6a4911 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832736.649639:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd270a10c1c6a4911 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832736.649645:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832736.649664:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd270a10c1c6a4911 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.649670:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832736.649693:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd270a10c1c6a4911 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.649785:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a490a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd270a10c1c6a4911 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.649801:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832736.649808:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832736.649810:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832736.649818:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788832736.649829:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994249856:0@lo:103: 00000100:00100000:3.0:1788832736.649857:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832736.649958:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994249856 00000100:00100000:3.0:1788832736.649964:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994249856 00000100:00100000:3.0:1788832736.649999:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832736.650007:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+10:3317:x1875726994249856:12345-0@lo:103: 00010000:00010000:3.0:1788832736.650017:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832736.650029:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d1000/0xd270a10c1c6a4911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a490a expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.650043:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832736.650073:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+9:3317:x1875726994249856:12345-0@lo:103: Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832736.650079:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832736.650109:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994249856:0@lo:103: 00000100:00100000:3.0:1788832736.650126:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994249728 00000100:00100000:3.0:1788832736.650129:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994249728 00000100:00100000:3.0:1788832736.650144:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788832736.650150:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+9:6696:x1875726994249728:12345-0@lo:101: 00010000:00010000:3.0:1788832736.650158:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832736.650168:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d027e2200/0xd270a10c1c6a491f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4918 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.650183:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d027e2200/0xd270a10c1c6a491f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4918 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.650204:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d027e2200/0xd270a10c1c6a491f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4918 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.650211:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d027e2200, rc 0) 00000100:00100000:3.0:1788832736.650239:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+10:6696:x1875726994249728:12345-0@lo:101: Request processed in 89us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832736.650245:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788832736.650332:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994249728:0@lo:101: 00010000:00010000:0.0:1788832736.650342:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a4918 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a491f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.650351:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a4918 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a491f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832736.650366:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788832736.650384:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a4918 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a491f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.650391:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a4918 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a491f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832736.650398:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788832736.650401:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832736.650406:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788832736.650408:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788832736.650422:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.650429:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.650454:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.650466:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994249984:0@lo:101: 00000100:00100000:0.0:1788832736.650493:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832736.650516:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03cc5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788832736.650570:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994249984 00000100:00100000:3.0:1788832736.650575:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994249984 00000100:00100000:3.0:1788832736.650593:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788832736.650598:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+10:6696:x1875726994249984:12345-0@lo:101: 00010000:00010000:3.0:1788832736.650605:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832736.650613:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a492d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4926 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.650626:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a492d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4926 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.650634:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a492d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4926 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.650640:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d027e2600, rc 0) 00000100:00100000:3.0:1788832736.650676:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+11:6696:x1875726994249984:12345-0@lo:101: Request processed in 78us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832736.650683:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788832736.650799:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994249984:0@lo:101: 00010000:00010000:0.0:1788832736.650809:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a492d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.650817:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a492d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832736.650963:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250112:0@lo:501: 00000100:00100000:0.0:1788832736.650988:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832736.651087:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994250112 00000100:00100000:2.0:1788832736.651092:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994250112 00000100:00100000:2.0:1788832736.651114:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788832736.651120:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+11:6696:x1875726994250112:12345-0@lo:501: 00000100:00100000:2.0:1788832736.651304:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+11:6696:x1875726994250112:12345-0@lo:501: Request processed in 184us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832736.651311:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788832736.651413:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03cc5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788832736.651427:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250112:0@lo:501: 00000100:00100000:0.0:1788832736.651461:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250240:0@lo:503: 00000100:00100000:0.0:1788832736.651499:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832736.651556:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03cc5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788832736.651596:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994250240 00000100:00100000:3.0:1788832736.651600:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994250240 00000100:00100000:2.0:1788832736.651638:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788832736.651645:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+11:6696:x1875726994250240:12345-0@lo:503: 00000100:00100000:2.0:1788832736.651860:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+11:6696:x1875726994250240:12345-0@lo:503: Request processed in 214us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832736.651867:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788832736.652004:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250240:0@lo:503: 00000040:00080000:0.0:1788832736.652282:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788832736.652333:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250368:0@lo:502: 00000100:00100000:0.0:1788832736.652366:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832736.652451:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03cc5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788832736.652521:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994250368 00000100:00100000:3.0:1788832736.652531:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994250368 00000100:00100000:3.0:1788832736.652553:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788832736.652559:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+11:6696:x1875726994250368:12345-0@lo:502: 00000100:00100000:3.0:1788832736.652814:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+11:6696:x1875726994250368:12345-0@lo:502: Request processed in 253us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832736.652822:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788832736.653043:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250368:0@lo:502: 00000040:00080000:0.0:1788832736.653282:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788832736.653329:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788832736.653361:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788832736.653407:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788832736.653456:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788832736.653491:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788832736.653516:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250496:0@lo:502: 00000100:00100000:0.0:1788832736.653554:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832736.653623:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03cc5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788832736.653662:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994250496 00000100:00100000:3.0:1788832736.653667:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994250496 00000100:00100000:3.0:1788832736.653835:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788832736.653844:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+11:6696:x1875726994250496:12345-0@lo:502: 00000100:00100000:3.0:1788832736.653999:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+11:6696:x1875726994250496:12345-0@lo:502: Request processed in 156us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832736.654006:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788832736.654076:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250496:0@lo:502: 00000040:00080000:0.0:1788832736.654153:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788832736.654164:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788832736.654672:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788832736.654679:0:6715:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788832736.654685:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832736.654687:0:6715:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788832736.654691:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832736.654715:0:6715:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff984d20340000) 00000020:00000080:0.0:1788832736.654733:0:6715:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788832736.654739:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788832736.654811:0:6715:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984d39f1a000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788832736.654818:0:6715:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788832736.654824:0:6715:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd270a10c1c6a493b 00010000:00010000:0.0:1788832736.662222:0:6715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788832736.662903:0:6715:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788832736.666349:0:6715:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788832736.667060:0:6715:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788832736.676311:0:6715:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788832736.677293:0:6715:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788832736.686515:0:6715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788832736.686527:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832736.686533:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832736.686540:0:6715:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788832736.686545:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832736.686549:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832736.686550:0:6715:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788832736.686553:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788832736.686555:0:6715:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788832736.686610:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832736.686613:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832736.686615:0:6715:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788832736.686618:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788832736.686779:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788832736.686802:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788832736.686819:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a492d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832736.686831:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a492d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832736.686851:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d39f1a000 from 1 10000000:01000000:2.0:1788832736.686854:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788832736.686899:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832736.686907:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832736.686917:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832736.686939:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250624:0@lo:101: 00000100:00100000:2.0:1788832736.686999:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832736.687044:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03697cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832736.687174:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994250624 00000100:00100000:1.0:1788832736.687181:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994250624 00000100:00100000:1.0:1788832736.687223:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788832736.687232:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+11:6696:x1875726994250624:12345-0@lo:101: 00010000:00010000:1.0:1788832736.687244:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832736.687254:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d05f05200/0xd270a10c1c6a4949 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4942 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832736.687274:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d05f05200/0xd270a10c1c6a4949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4942 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832736.687284:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d05f05200/0xd270a10c1c6a4949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4942 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832736.687292:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05200, rc 0) 00000100:00100000:1.0:1788832736.687332:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+12:6696:x1875726994250624:12345-0@lo:101: Request processed in 101us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832736.687339:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788832736.687379:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250624:0@lo:101: 00010000:00010000:1.0:1788832736.687392:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4949 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832736.687405:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4949 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832736.687520:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250752:0@lo:501: 00000100:00100000:1.0:1788832736.687545:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832736.687558:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d08bcea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788832736.687613:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994250752 00000100:00100000:2.0:1788832736.687618:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994250752 00000100:00100000:2.0:1788832736.687645:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788832736.687652:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:6696:x1875726994250752:12345-0@lo:501: 00000100:00100000:2.0:1788832736.687884:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:6696:x1875726994250752:12345-0@lo:501: Request processed in 220us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832736.687889:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250752:0@lo:501: 00000100:00100000:2.0:1788832736.687891:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788832736.687917:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250880:0@lo:503: 00000100:00100000:3.0:1788832736.687953:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832736.687986:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d776c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832736.688044:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994250880 00000100:00100000:2.0:1788832736.688048:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994250880 00000100:00100000:2.0:1788832736.688818:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788832736.688830:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:6696:x1875726994250880:12345-0@lo:503: 00000100:00100000:2.0:1788832736.692041:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:6696:x1875726994250880:12345-0@lo:503: Request processed in 3208us (4081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832736.692063:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788832736.692251:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994250880:0@lo:503: 00000040:00080000:3.0:1788832736.692524:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788832736.692775:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251008:0@lo:502: 00000100:00100000:3.0:1788832736.692821:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832736.692857:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994251008 00000100:00100000:3.0:1788832736.692861:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d776c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832736.692864:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994251008 00000100:00100000:1.0:1788832736.692960:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788832736.692970:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:6696:x1875726994251008:12345-0@lo:502: 00000100:00100000:1.0:1788832736.693192:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:6696:x1875726994251008:12345-0@lo:502: Request processed in 223us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832736.693200:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788832736.696461:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251008:0@lo:502: 00000040:00080000:3.0:1788832736.696985:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788832736.697325:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788832736.697366:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251136:0@lo:502: 00000100:00100000:3.0:1788832736.697524:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832736.697568:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d776c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832736.697693:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994251136 00000100:00100000:1.0:1788832736.697809:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994251136 00000100:00100000:1.0:1788832736.697855:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788832736.697864:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+12:6696:x1875726994251136:12345-0@lo:502: 00000100:00100000:1.0:1788832736.698187:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+12:6696:x1875726994251136:12345-0@lo:502: Request processed in 323us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832736.698195:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788832736.698261:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251136:0@lo:502: 00000040:00080000:3.0:1788832736.698362:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788832736.698372:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788832736.699035:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832736.699050:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832736.699052:0:6719:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788832736.699058:0:6719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984d39f1a000 00000020:00000080:0.0:1788832736.699061:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788832736.699081:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832736.699085:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832736.699086:0:6719:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788832736.699089:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788832736.699268:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788832736.699286:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788832736.699309:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4949 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.699319:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4949 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832736.699362:0:6696:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788832736.699365:0:6696:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984d39f1a000 10000000:01000000:3.0:1788832736.699368:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984d39f1a000 10000000:01000000:3.0:1788832736.699371:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788832736.699376:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984d39f1a000 from 1 10000000:01000000:3.0:1788832736.699379:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788832736.699406:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.699475:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.699485:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832736.699503:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251264:0@lo:101: 00000100:00100000:3.0:1788832736.699543:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832736.699667:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832736.699695:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994251264 00000100:00100000:1.0:1788832736.699711:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994251264 00000100:00100000:3.0:1788832736.699853:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788832736.699863:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:6696:x1875726994251264:12345-0@lo:101: 00010000:00010000:3.0:1788832736.699964:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832736.699978:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4950 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.700000:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4950 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.700010:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4950 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.700018:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d027e2e00, rc 0) 00000100:00100000:3.0:1788832736.700095:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:6696:x1875726994251264:12345-0@lo:101: Request processed in 233us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832736.700101:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788832736.700164:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251264:0@lo:101: 00010000:00010000:1.0:1788832736.700178:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4957 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832736.700198:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4957 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832736.700275:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251392:0@lo:501: 00000100:00100000:1.0:1788832736.700302:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832736.700367:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d08bcec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832736.700399:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994251392 00000100:00100000:3.0:1788832736.700404:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994251392 00000100:00100000:3.0:1788832736.700547:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788832736.700555:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:6696:x1875726994251392:12345-0@lo:501: 00000100:00100000:3.0:1788832736.700825:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:6696:x1875726994251392:12345-0@lo:501: Request processed in 270us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832736.700832:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788832736.701050:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251392:0@lo:501: 00000100:00100000:2.0:1788832736.701082:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251520:0@lo:503: 00000100:00100000:2.0:1788832736.701127:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832736.701153:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03697d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832736.701233:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994251520 00000100:00100000:3.0:1788832736.701238:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994251520 00000100:00100000:3.0:1788832736.701270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788832736.701277:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:6696:x1875726994251520:12345-0@lo:503: 00000100:00100000:3.0:1788832736.701492:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:6696:x1875726994251520:12345-0@lo:503: Request processed in 214us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832736.701498:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251520:0@lo:503: 00000100:00100000:3.0:1788832736.701504:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000040:00080000:2.0:1788832736.702174:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788832736.702241:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251648:0@lo:502: 00000100:00100000:2.0:1788832736.702284:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832736.702318:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03697d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832736.702382:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994251648 00000100:00100000:1.0:1788832736.702388:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994251648 00000100:00100000:1.0:1788832736.702484:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788832736.702492:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+13:6696:x1875726994251648:12345-0@lo:502: 00000100:00100000:1.0:1788832736.702968:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+13:6696:x1875726994251648:12345-0@lo:502: Request processed in 476us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832736.702976:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788832736.703053:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251648:0@lo:502: 00000040:00080000:2.0:1788832736.703303:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788832736.703352:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788832736.703388:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788832736.703457:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788832736.703495:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788832736.703542:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788832736.703679:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788832736.703715:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788832736.703822:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788832736.703861:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788832736.703897:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788832736.703946:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788832736.704001:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788832736.704038:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788832736.704090:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788832736.704127:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788832736.704177:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788832736.704239:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788832736.704281:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788832736.704317:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788832736.704367:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788832736.704406:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788832736.704452:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788832736.704502:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788832736.704562:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788832736.704598:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788832736.704649:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788832736.704685:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788832736.704724:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251776:0@lo:502: 00000100:00100000:2.0:1788832736.704799:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832736.704842:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03697d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832736.705269:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994251776 00000100:00100000:1.0:1788832736.705277:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994251776 00000100:00100000:1.0:1788832736.705349:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788832736.705358:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+13:6696:x1875726994251776:12345-0@lo:502: 00000100:00100000:1.0:1788832736.705570:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+13:6696:x1875726994251776:12345-0@lo:502: Request processed in 212us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832736.705577:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788832736.705653:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994251776:0@lo:502: 00000040:00080000:0.0:1788832736.705724:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788832736.705735:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788832736.706426:0:6720:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788832736.706451:0:6720:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff984d06c30000) 00000020:00000080:3.0:1788832736.706471:0:6720:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788832736.706544:0:6720:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984d39f1a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788832736.706559:0:6720:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984d39f1a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788832736.706562:0:6720:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984d39f1a000 3 00010000:00080000:3.0:1788832736.706596:0:6720:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984c054de800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.141@tcp at head 00010000:00010000:3.0:1788832736.713303:0:6720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788832736.713520:0:6720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788832736.713566:0:6720:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788832736.713578:0:6720:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd270a10c1c6a4965 00000100:00080000:3.0:1788832736.713587:0:6720:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788832736.713592:0:6720:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff984c054de800 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:3.0:1788832736.715167:0:6720:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984d3bd56300 x1875726994251904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788832736.715208:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875726994251904:0@lo:38: 00000100:00100000:3.0:1788832736.715270:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788832736.715336:0:6720:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1788832736.716027:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788832736.716814:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788832736.716838:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788832736.716858:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4957 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.716869:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4957 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788832736.716921:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788832736.716924:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788832736.716925:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832736.716927:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832736.716928:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:2.0:1788832736.716928:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994251904 00000020:01000004:3.0:1788832736.716929:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832736.716931:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832736.716932:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788832736.716933:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788832736.716935:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832736.716936:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788832736.716936:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994251904 10000000:01000000:3.0:1788832736.716939:0:6696:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788832736.716942:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788832736.716943:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788832736.716944:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832736.716945:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832736.716946:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832736.716947:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832736.716947:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832736.716948:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788832736.716949:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788832736.716950:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832736.716951:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788832736.716966:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 10000000:01000000:3.0:1788832736.716970:0:6696:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788832736.716972:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875726994251904:12345-0@lo:38: 00000100:00100000:3.0:1788832736.716982:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994252032:0@lo:253: 00010000:00080000:2.0:1788832736.716992:0:5855:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000100:00100000:3.0:1788832736.717029:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788832736.717053:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd270a10c1c6a496c 00000100:00100000:3.0:1788832736.717058:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d776c0 going to sleep for 11 seconds 00000004:00100000:2.0:1788832736.717068:0:5855:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788832736.717096:0:5855:0:(import.c:65:import_set_state_nolock()) ffff984c054c6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832736.717154:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875726994251904:12345-0@lo:38: Request processed in 180us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832736.717162:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788832736.717224:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff984d3bd56300 x1875726994251904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832736.717234:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832736.717241:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788832736.717248:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788832736.717252:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788832736.717260:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984c054de800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788832736.717261:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994252032 00000100:00100000:2.0:1788832736.717265:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994252032 00000100:00100000:3.0:1788832736.717266:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875726994251904:0@lo:38: 00000100:00100000:2.0:1788832736.717293:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788832736.717300:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:6696:x1875726994252032:12345-0@lo:253: 20000000:01000000:2.0:1788832736.717326:0:5847:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788832736.717337:0:5847:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788832736.752578:0:5847:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788832736.752598:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788832736.752653:0:5869:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788832736.752658:0:5869:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788832736.752678:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832736.752705:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d027e2a00/0xd270a10c1c6a48d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a48cb expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832736.752714:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832736.752775:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d027e2a00/0xd270a10c1c6a48d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a48cb expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832736.752789:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d027e2a00/0xd270a10c1c6a48d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a48cb expref: 13 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832736.752802:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5869:1875726994252160:0@lo:104: 00000100:00100000:2.0:1788832736.752859:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832736.752914:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03697cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832736.753554:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994252160 00000100:00100000:3.0:1788832736.753562:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994252160 00000100:00100000:3.0:1788832736.753612:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788832736.753621:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:5869:x1875726994252160:12345-0@lo:104: 00010000:00010000:3.0:1788832736.753633:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d013d0c00/0xd270a10c1c6a48cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a48d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.753691:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788832736.753697:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:5869:x1875726994252160:12345-0@lo:104: Request processed in 78us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832736.753704:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788832736.754024:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5869:1875726994252160:0@lo:104: 00010000:00010000:2.0:1788832736.754045:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.754127:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832736.754134:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d013d0c00/0xd270a10c1c6a48cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a48d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.754142:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d013d0c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788832736.754145:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d013d0c00/0xd270a10c1c6a48cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a48d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.754153:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d013d0c00/0xd270a10c1c6a48cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a48d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832736.754160:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d013d0c00/0xd270a10c1c6a48cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a48d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832736.754165:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832736.754201:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d013d0c00/0xd270a10c1c6a48cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a48d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.754208:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832736.754239:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d013d0c00/0xd270a10c1c6a48cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a48d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.754246:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d013d0c00/0xd270a10c1c6a48cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a48d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832736.754262:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832736.754264:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832736.754266:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832736.754279:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994252288:0@lo:103: 00000100:00100000:0.0:1788832736.754329:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832736.754493:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994252288 00000100:00100000:3.0:1788832736.754498:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994252288 00010000:00010000:3.0:1788832736.754517:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d027e2a00/0xd270a10c1c6a48d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a48cb expref: 14 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832736.754544:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788832736.754551:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d08a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32c45e-9a6a-4349-b87e-107522b34816+14:3317:x1875726994252288:12345-0@lo:103: 00010000:00010000:3.0:1788832736.754562:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832736.754566:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d027e2a00/0xd270a10c1c6a48d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a48cb expref: 14 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.754577:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d027e2a00/0xd270a10c1c6a48d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a48cb expref: 14 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.754601:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e2a00/0xd270a10c1c6a48d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a48cb expref: 14 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.754614:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.754622:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788832736.754634:0:5839:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001977298s 00010000:00010000:3.0:1788832736.754638:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.754645:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.754651:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.754658:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.754664:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d013d1e00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788832736.754667:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.754674:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.754694:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832736.754843:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832736.754857:0:5869:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832736.754866:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832736.754872:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4973 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832736.754873:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d08a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32c45e-9a6a-4349-b87e-107522b34816+13:3317:x1875726994252288:12345-0@lo:103: Request processed in 323us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832736.754879:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788832736.755048:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994252288:0@lo:103: 00000100:00100000:0.0:1788832736.763804:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:6696:x1875726994252032:12345-0@lo:253: Request processed in 46496us (46766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832736.763814:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:6696:1875726994252032:0@lo:253: 00000100:00100000:0.0:1788832736.763819:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 10000000:01000000:3.0:1788832736.763829:0:6696:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788832736.763832:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788832736.763835:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788832736.763837:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832736.763838:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832736.763840:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832736.763841:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832736.763854:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832736.763855:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788832736.763857:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788832736.763859:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832736.763861:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788832736.763877:0:6696:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788832736.768339:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788832736.768540:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788832736.770031:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788832736.770267:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788832736.770502:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788832736.771969:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788832736.775671:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1788832736.855704:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788832737.002816:0:6696:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788832737.002823:0:6696:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788832737.002856:0:6696:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788832737.002912:0:6696:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.141@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788832737.002981:0:6696:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788832737.003004:0:6696:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788832737.881424:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832738.906321:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832739.927783:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832740.950086:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832741.974037:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832742.039358:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994252544:0@lo:400: 00000100:00100000:2.0:1788832742.039559:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994252416:0@lo:400: 00000100:00100000:0.0:1788832742.039873:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994252672:0@lo:400: 00000100:00100000:2.0:1788832742.040944:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832742.041096:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832742.041172:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994252672 00000100:00100000:2.0:1788832742.041180:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994252672 00000100:00100000:2.0:1788832742.041298:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788832742.041306:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994252672:12345-0@lo:400: 00000100:00100000:2.0:1788832742.041364:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994252672:12345-0@lo:400: Request processed in 57us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832742.041371:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788832742.041385:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d06479c00 x1875726994252672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788832742.041393:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832742.041400:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994252672:0@lo:400: 00000100:00100000:1.0:1788832742.042628:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832742.042768:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994252416 00000100:00100000:1.0:1788832742.042775:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994252416 00000100:00100000:2.0:1788832742.042779:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994252544 00000100:00100000:2.0:1788832742.042783:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994252544 00000100:00100000:2.0:1788832742.042807:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832742.042814:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994252544:12345-0@lo:400: 00000100:00100000:2.0:1788832742.042865:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994252544:12345-0@lo:400: Request processed in 51us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832742.042871:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832742.043067:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788832742.043075:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:3314:x1875726994252416:12345-0@lo:400: 00000100:00100000:1.0:1788832742.043127:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:3314:x1875726994252416:12345-0@lo:400: Request processed in 54us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832742.043134:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788832742.043213:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994252416:0@lo:400: 00010000:00080000:1.0:1788832742.043260:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d0647a300 x1875726994252544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832742.043271:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994252544:0@lo:400: 00000001:02000400:0.0:1788832742.270727:0:7063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788832742.998080:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832744.022016:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788832744.598124:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788832744.598131:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984d2a26c800 from 21 10000000:01000000:3.0:1788832744.598136:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788832744.598194:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832744.598206:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832744.598217:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832744.598239:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994252800:0@lo:101: 00000100:00100000:3.0:1788832744.598312:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.598388:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aec7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788832744.598952:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994252800 00000100:00100000:0.0:1788832744.598969:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994252800 00000100:00100000:0.0:1788832744.599023:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788832744.599033:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:5850:x1875726994252800:12345-0@lo:101: 00010000:00010000:0.0:1788832744.599045:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832744.599057:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4981 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a497a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832744.599080:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a497a expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832744.599091:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a497a expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832744.599100:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d00031800, rc 0) 00000100:00100000:0.0:1788832744.599154:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:5850:x1875726994252800:12345-0@lo:101: Request processed in 123us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832744.599161:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788832744.599508:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994252800:0@lo:101: 00010000:00010000:3.0:1788832744.599524:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4981 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832744.599534:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4981 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832744.599590:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994252928:0@lo:501: 00000100:00100000:3.0:1788832744.599620:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.599656:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aec7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788832744.599712:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994252928 00000100:00100000:0.0:1788832744.599717:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994252928 00000100:00100000:0.0:1788832744.599829:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788832744.599838:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:5850:x1875726994252928:12345-0@lo:501: 00000100:00100000:0.0:1788832744.600153:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:5850:x1875726994252928:12345-0@lo:501: Request processed in 316us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832744.600160:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788832744.600225:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994252928:0@lo:501: 00000100:00100000:1.0:1788832744.600254:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994253056:0@lo:503: 00000100:00100000:1.0:1788832744.600293:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832744.605421:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06b329c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832744.609342:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994253056 00000100:00100000:3.0:1788832744.609360:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994253056 00000100:00100000:3.0:1788832744.609497:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788832744.609507:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:5850:x1875726994253056:12345-0@lo:503: 00000100:00100000:3.0:1788832744.610837:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:5850:x1875726994253056:12345-0@lo:503: Request processed in 1326us (10537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832744.610847:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788832744.611344:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994253056:0@lo:503: 00000100:00100000:3.0:1788832744.612287:0:7167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7167:1875726994253184:0@lo:502: 00000100:00100000:3.0:1788832744.612468:0:7167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.612559:0:7167:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aec73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832744.612888:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994253184 00000100:00100000:1.0:1788832744.612895:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994253184 00000100:00100000:1.0:1788832744.612936:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788832744.612944:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:7167:x1875726994253184:12345-0@lo:502: 00000100:00100000:1.0:1788832744.614001:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:7167:x1875726994253184:12345-0@lo:502: Request processed in 1054us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832744.614011:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788832744.614062:0:7167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7167:1875726994253184:0@lo:502: 00000100:00100000:3.0:1788832744.614125:0:7167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7167:1875726994253312:0@lo:502: 00000100:00100000:3.0:1788832744.614169:0:7167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.614209:0:7167:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aec73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832744.614889:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994253312 00000100:00100000:0.0:1788832744.614902:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994253312 00000100:00100000:0.0:1788832744.614940:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788832744.614950:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+14:7167:x1875726994253312:12345-0@lo:502: 00000100:00100000:0.0:1788832744.615165:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:7167:x1875726994253312:12345-0@lo:502: Request processed in 216us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832744.615179:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788832744.615272:0:7167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7167:1875726994253312:0@lo:502: 00000040:00080000:3.0:1788832744.615297:0:7167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788832744.616970:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788832744.617000:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788832744.617011:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4981 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832744.617022:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4981 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832744.617032:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788832744.617034:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984d2a26c800 from 4 10000000:01000000:1.0:1788832744.617037:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788832744.617073:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832744.617081:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832744.617090:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832744.617109:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994253440:0@lo:101: 00000100:00100000:1.0:1788832744.617160:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832744.617211:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06b32780 going to sleep for 11 seconds 00000100:00100000:2.0:1788832744.617281:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994253440 00000100:00100000:2.0:1788832744.617288:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994253440 00000100:00100000:2.0:1788832744.617332:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788832744.617340:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+13:5850:x1875726994253440:12345-0@lo:101: 00010000:00010000:2.0:1788832744.617350:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832744.617362:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d013d0400/0xd270a10c1c6a498f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4988 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832744.617381:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d0400/0xd270a10c1c6a498f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4988 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832744.617391:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d013d0400/0xd270a10c1c6a498f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4988 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832744.617423:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d013d0400, rc 0) 00000100:00100000:2.0:1788832744.617465:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994253440:12345-0@lo:101: Request processed in 126us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832744.617472:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788832744.617544:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994253440:0@lo:101: 00010000:00010000:3.0:1788832744.617556:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a498f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832744.617565:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a498f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832744.617606:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994253568:0@lo:256: 00000100:00100000:3.0:1788832744.617634:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.617656:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aec73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832744.617709:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994253568 00000100:00100000:0.0:1788832744.617713:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994253568 00000100:00100000:0.0:1788832744.617783:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788832744.617790:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994253568:12345-0@lo:256: 20000000:01000000:0.0:1788832744.617802:0:5848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788832744.617822:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788832744.617825:0:5848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788832744.617903:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994253568:12345-0@lo:256: Request processed in 113us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832744.617910:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788832744.618058:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994253568:0@lo:256: 10000000:01000000:3.0:1788832744.618100:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788832744.618105:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a498f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832744.618113:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a498f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832744.618130:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788832744.618133:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788832744.618135:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788832744.618152:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832744.618159:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832744.618166:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832744.618177:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994253696:0@lo:101: 00000100:00100000:3.0:1788832744.618201:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.618232:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aec73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832744.618316:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994253696 00000100:00100000:0.0:1788832744.618320:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994253696 00000100:00100000:0.0:1788832744.618338:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788832744.618345:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994253696:12345-0@lo:101: 00010000:00010000:0.0:1788832744.618352:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832744.618361:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d00031000/0xd270a10c1c6a499d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4996 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832744.618375:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d00031000/0xd270a10c1c6a499d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4996 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832744.618384:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d00031000/0xd270a10c1c6a499d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4996 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832744.618390:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d00031000, rc 0) 00000100:00100000:0.0:1788832744.618440:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994253696:12345-0@lo:101: Request processed in 95us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832744.618454:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788832744.618597:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994253696:0@lo:101: 00010000:00010000:3.0:1788832744.618609:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a499d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832744.618617:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a499d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832744.618667:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994253824:0@lo:501: 00000100:00100000:3.0:1788832744.618692:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.618713:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aec73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832744.618996:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994253824 00000100:00100000:0.0:1788832744.619001:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994253824 00000100:00100000:0.0:1788832744.619031:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788832744.619037:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994253824:12345-0@lo:501: 00000100:00100000:0.0:1788832744.619446:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994253824:12345-0@lo:501: Request processed in 408us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832744.619453:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788832744.625566:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994253824:0@lo:501: 00000100:00100000:3.0:1788832744.625628:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994253952:0@lo:503: 00000100:00100000:3.0:1788832744.625706:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.625890:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aec73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832744.628638:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994253952 00000100:00100000:2.0:1788832744.628651:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994253952 00000100:00100000:2.0:1788832744.628715:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788832744.628730:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994253952:12345-0@lo:503: 00000100:00100000:2.0:1788832744.629442:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994253952:12345-0@lo:503: Request processed in 717us (3734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832744.629451:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788832744.629560:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994253952:0@lo:503: 00000100:00100000:3.0:1788832744.630153:0:7168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7168:1875726994254080:0@lo:502: 00000100:00100000:3.0:1788832744.630201:0:7168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.630241:0:7168:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aec79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832744.630294:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994254080 00000100:00100000:0.0:1788832744.630300:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994254080 00000100:00100000:0.0:1788832744.630338:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788832744.630346:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+15:7168:x1875726994254080:12345-0@lo:502: 00000100:00100000:0.0:1788832744.630580:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+15:7168:x1875726994254080:12345-0@lo:502: Request processed in 235us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832744.630587:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788832744.630702:0:7168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7168:1875726994254080:0@lo:502: 00000020:01000000:3.0:1788832744.630726:0:7168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788832744.630924:0:7168:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788832744.630932:0:7168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832744.630934:0:7168:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788832744.630940:0:7168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788832744.630944:0:7168:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.141@tcp to nid 0x20000c0a8ce8d (192.168.206.141@tcp) 00000020:01000000:3.0:1788832744.630965:0:7168:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788832744.630968:0:7168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788832744.630982:0:7168:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff984d06c34d28) 00000020:00000080:3.0:1788832744.631000:0:7168:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788832744.631007:0:7168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788832744.631073:0:7168:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788832744.631078:0:7168:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788832744.631085:0:7168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a49ab 00010000:00080000:3.0:1788832744.631111:0:7168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984d3faa3800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.141@tcp at head 00010000:00010000:3.0:1788832744.631329:0:7168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788832744.684974:0:7168:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788832744.685004:0:7168:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788832744.685631:0:7168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832744.685866:0:7168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832744.685927:0:7168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788832744.685997:0:7168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788832744.688384:0:7172:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832744.688403:0:7172:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788832744.692877:0:7168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788832744.692898:0:7168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788832744.692958:0:7168:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788832744.692987:0:7168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd270a10c1c6a49b2 00000100:00080000:1.0:1788832744.693002:0:7168:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832744.693010:0:7168:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff984d3faa3800 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:1.0:1788832744.693054:0:7168:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984d0647b480 x1875726994254208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832744.693083:0:7168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788832744.693147:0:7168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832744.693152:0:7168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832744.693154:0:7168:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788832744.693158:0:7168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832744.693162:0:7168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832744.693164:0:7168:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788832744.693167:0:7168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788832744.693169:0:7168:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788832744.693204:0:7168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06479f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7168:1875726994254336:0@lo:502: 00000100:00100000:1.0:1788832744.693303:0:7168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832744.693361:0:7168:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18d71300 going to sleep for 11 seconds 00000100:00100000:1.0:1788832744.693469:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994254336 00000100:00100000:1.0:1788832744.693476:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994254336 00000100:00100000:1.0:1788832744.693522:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788832744.693532:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+15:7168:x1875726994254336:12345-0@lo:502: 00000100:00100000:1.0:1788832744.693827:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+15:7168:x1875726994254336:12345-0@lo:502: Request processed in 296us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832744.693836:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788832744.693848:0:7168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06479f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7168:1875726994254336:0@lo:502: 00000020:01000000:3.0:1788832744.693877:0:7168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832744.693882:0:7168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832744.693884:0:7168:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000100:00100000:1.0:1788832744.693885:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994254464:0@lo:400: 00000040:00080000:3.0:1788832744.693890:0:7168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1788832744.693921:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832744.693979:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994254592:0@lo:400: 00000100:00100000:1.0:1788832744.694017:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832744.694062:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994254464 00000100:00100000:1.0:1788832744.694067:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994254464 00000100:00100000:1.0:1788832744.694104:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994254592 00000100:00100000:1.0:1788832744.694107:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994254592 00000100:00100000:1.0:1788832744.694142:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788832744.694151:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994254464:12345-0@lo:400: 00000100:00100000:3.0:1788832744.694166:0:5853:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788832744.694173:0:5853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788832744.694193:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994254464:12345-0@lo:400: Request processed in 44us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832744.694202:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788832744.694213:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832744.694218:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994254592:12345-0@lo:400: 00000100:00100000:1.0:1788832744.694250:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994254592:12345-0@lo:400: Request processed in 31us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832744.694256:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000000:1.0:1788832744.694280:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788832744.694317:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788832744.694330:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a499d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832744.694341:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a499d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832744.694354:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788832744.694358:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff984d06434d28 from 1 10000000:01000000:1.0:1788832744.694362:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788832744.694407:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832744.694425:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832744.694436:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832744.694451:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994254720:0@lo:101: 00000100:00100000:1.0:1788832744.694480:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832744.694510:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10ffc300 going to sleep for 11 seconds 00000100:00080000:1.0:1788832744.694540:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788832744.694562:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d06479500 x1875726994254592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832744.694573:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994254592:0@lo:400: 00010000:00080000:1.0:1788832744.694595:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d0647a680 x1875726994254464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832744.694605:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994254464:0@lo:400: 00000100:00100000:3.0:1788832744.694628:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994254720 00000100:00100000:3.0:1788832744.694633:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994254720 00000100:00100000:3.0:1788832744.694670:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788832744.694678:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994254720:12345-0@lo:101: 00010000:00010000:3.0:1788832744.694688:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832744.694703:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a49c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a49b9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832744.694727:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a49c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a49b9 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832744.694740:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a49c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a49b9 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832744.694779:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994254208:0@lo:8: 00010000:00010000:3.0:1788832744.694785:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d027e3000, rc 0) 00000100:00100000:2.0:1788832744.694821:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.694824:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994254720:12345-0@lo:101: Request processed in 148us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832744.694831:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788832744.694889:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994254208 00000100:00100000:2.0:1788832744.694894:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994254208 00000100:00100000:2.0:1788832744.694931:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788832744.694937:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1875726994254208:12345-0@lo:8: 00010000:00080000:2.0:1788832744.694960:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:2.0:1788832744.694995:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd270a10c1c6a49c7 00002000:00100000:2.0:1788832744.695046:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff984c054c5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788832744.695051:0:6698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788832744.695056:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788832744.695190:0:6698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788832744.695362:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788832744.695390:0:6698:0:(import.c:65:import_set_state_nolock()) ffff984c054c1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832744.695464:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875726994254208:12345-0@lo:8: Request processed in 526us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832744.695472:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788832744.695533:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d0647b480 x1875726994254208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788832754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832744.695543:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832744.695550:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788832744.695560:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788832744.695565:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788832744.695568:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d3faa3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788832744.695595:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788832744.695601:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994254208:0@lo:8: 00000004:00080000:3.0:1788832744.695635:0:7172:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788832744.695817:0:7172:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 248386072380ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788832744.695821:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994254720:0@lo:101: 00010000:00010000:1.0:1788832744.695843:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a49c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832744.695856:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a49c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832744.695929:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994254848:0@lo:501: 00000100:00100000:1.0:1788832744.695979:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832744.696044:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10ffc300 going to sleep for 11 seconds 00000100:00100000:1.0:1788832744.696064:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994254848 00000100:00100000:1.0:1788832744.696070:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994254848 00000100:00100000:1.0:1788832744.696118:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788832744.696128:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994254848:12345-0@lo:501: 00000100:00100000:1.0:1788832744.696572:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994254848:12345-0@lo:501: Request processed in 444us (592us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788832744.696581:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788832744.697187:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994254848:0@lo:501: 10000000:01000000:3.0:1788832744.697231:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788832744.697240:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a49c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832744.697251:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a49c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788832744.752929:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788832744.811020:0:7173:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788832744.811062:0:7173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7173:1875726994255104:0@lo:7: 00000100:00100000:3.0:1788832744.811145:0:7173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.811207:0:7173:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18d71300 going to sleep for 11 seconds 00000100:00100000:3.0:1788832744.811242:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994254976:0@lo:13: 00000100:00100000:3.0:1788832744.811269:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.811319:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994254976 00000100:00100000:3.0:1788832744.811327:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994254976 00000100:00100000:3.0:1788832744.811387:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832744.811407:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875726994254976:12345-0@lo:13: 00002000:00000024:3.0:1788832744.811444:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788832744.811496:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875726994254976:12345-0@lo:13: Request processed in 92us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832744.811505:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788832744.811726:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994255104 00000100:00100000:2.0:1788832744.811731:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994255104 00000100:00100000:2.0:1788832744.811778:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788832744.811786:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7173:x1875726994255104:12345-0@lo:7: 00000100:00080000:3.0:1788832744.821677:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788832744.822000:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3bd55880 x1875726994254976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832744.822054:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994254976:0@lo:13: 00002000:00080000:3.0:1788832744.848056:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788832744.848066:0:6700:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788832744.848178:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7173:x1875726994255104:12345-0@lo:7: Request processed in 36387us (37027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832744.848193:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788832744.848259:0:7173:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3bd54000 x1875726994255104/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788832760 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832744.848276:0:7173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7173:1875726994255104:0@lo:7: 00000004:00080000:3.0:1788832744.848294:0:7173:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788832744.848338:0:7173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7173:1875726994255232:0@lo:5: 00000100:00100000:3.0:1788832744.848374:0:7173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.851982:0:7173:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18d71300 going to sleep for 11 seconds 00000100:00100000:3.0:1788832744.852022:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994255232 00000100:00100000:3.0:1788832744.852033:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994255232 00000100:00100000:3.0:1788832744.852097:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788832744.852108:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7173:x1875726994255232:12345-0@lo:5: 00002000:00080000:3.0:1788832744.852147:0:6700:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788832744.852153:0:6700:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788832744.852591:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7173:x1875726994255232:12345-0@lo:5: Request processed in 483us (4214us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788832744.852598:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788832744.852644:0:7173:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3bd54000 x1875726994255232/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832760 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832744.852662:0:7173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7173:1875726994255232:0@lo:5: 00000004:00080000:3.0:1788832744.852685:0:7173:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788832744.852726:0:7173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7173:1875726994255360:0@lo:700: 00000100:00100000:3.0:1788832744.852780:0:7173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.852800:0:7173:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18d71300 going to sleep for 11 seconds 00000100:00100000:3.0:1788832744.852834:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994255360 00000100:00100000:3.0:1788832744.852839:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994255360 00000100:00100000:3.0:1788832744.852867:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832744.852874:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7173:x1875726994255360:12345-0@lo:700: 00000100:00100000:3.0:1788832744.852901:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6707:1875726994255488:0@lo:700: 00000100:00100000:3.0:1788832744.852928:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832744.852944:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18d71600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832744.858861:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994255488 00000100:00100000:3.0:1788832744.858880:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994255488 00000100:00100000:3.0:1788832744.858945:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832744.858957:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6707:x1875726994255488:12345-0@lo:700: 40000000:02000000:2.0:1788832744.917651:0:5860:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788832744.930414:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6707:x1875726994255488:12345-0@lo:700: Request processed in 71450us (77475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832744.930429:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788832744.932514:0:6707:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3bd55500 x1875726994255488/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788832760 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832744.932539:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6707:1875726994255488:0@lo:700: 40000000:02000000:1.0:1788832744.932560:0:6707:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1788832745.030892:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7173:x1875726994255360:12345-0@lo:700: Request processed in 178010us (178103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832745.030905:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:2.0:1788832745.030992:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788832745.031003:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:1.0:1788832745.031090:0:7173:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3bd55f80 x1875726994255360/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788832760 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832745.031106:0:7173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7173:1875726994255360:0@lo:700: 00010000:00010000:1.0:1788832745.051246:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:1.0:1788832745.052073:0:7173:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788832745.057132:0:7173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7173:1875726994255616:0@lo:5: 00000100:00100000:1.0:1788832745.057201:0:7173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832745.057326:0:7173:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10db26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832745.057418:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994255616 00000100:00100000:3.0:1788832745.057426:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994255616 00000100:00100000:3.0:1788832745.057528:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788832745.057538:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7173:x1875726994255616:12345-0@lo:5: 00002000:00080000:3.0:1788832745.063089:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788832745.063117:0:6700:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788832745.066947:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7173:x1875726994255616:12345-0@lo:5: Request processed in 9404us (9740us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788832745.066960:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788832745.067036:0:7173:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d0647a680 x1875726994255616/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832761 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832745.067049:0:7173:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788832745.067065:0:7173:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff984d0647a680 x1875726994255616/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832761 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832745.067091:0:7173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7173:1875726994255616:0@lo:5: 00000004:00080000:1.0:1788832745.067105:0:7173:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788832746.071926:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788832746.353031:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788832747.094077:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832748.125062:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832749.141826:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832749.732511:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994255872:0@lo:400: 00000100:00100000:3.0:1788832749.732695:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832749.732770:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788832749.732778:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994255744:0@lo:400: 00000100:00100000:3.0:1788832749.732806:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832749.732838:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994256000:0@lo:400: 00000100:00100000:3.0:1788832749.732859:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832749.732873:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832749.732877:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994256128:0@lo:400: 00000100:00100000:3.0:1788832749.732898:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832749.732925:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994255872 00000100:00100000:3.0:1788832749.732931:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994255872 00000100:00100000:3.0:1788832749.732966:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994256000 00000100:00100000:3.0:1788832749.732968:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994256000 00000100:00100000:3.0:1788832749.732994:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788832749.733001:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994255872:12345-0@lo:400: 00000100:00100000:3.0:1788832749.733059:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994255872:12345-0@lo:400: Request processed in 57us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832749.733169:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788832749.733188:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788832749.733196:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994256000:12345-0@lo:400: 00000100:00100000:3.0:1788832749.733228:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994256000:12345-0@lo:400: Request processed in 34us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832749.733234:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788832749.733259:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994255744 00000100:00100000:3.0:1788832749.733263:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994255744 00000100:00100000:3.0:1788832749.733357:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788832749.733375:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+16:3317:x1875726994255744:12345-0@lo:400: 00000100:00100000:3.0:1788832749.733404:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+16:3317:x1875726994255744:12345-0@lo:400: Request processed in 40us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832749.733410:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788832749.733437:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994256128 00000100:00100000:3.0:1788832749.733440:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994256128 00000100:00100000:3.0:1788832749.733463:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832749.733468:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994256128:12345-0@lo:400: 00000100:00100000:3.0:1788832749.733493:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994256128:12345-0@lo:400: Request processed in 24us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832749.733498:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788832749.733512:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832749.733516:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832749.733656:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994255744:0@lo:400: 00010000:00080000:3.0:1788832749.733671:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3bd54a80 x1875726994255872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832749.733682:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994255872:0@lo:400: 00010000:00080000:3.0:1788832749.733709:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3bd54000 x1875726994256128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832749.733717:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788832749.733727:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994256128:0@lo:400: 00010000:00080000:3.0:1788832749.733737:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3bd56d80 x1875726994256000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832749.733780:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994256000:0@lo:400: 00010000:00010000:0.0:1788832750.166266:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832750.230461:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994256256:0@lo:13: 00000100:00100000:3.0:1788832750.230532:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832750.230869:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994256256 00000100:00100000:2.0:1788832750.230878:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994256256 00000100:00100000:2.0:1788832750.230928:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788832750.230938:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994256256:12345-0@lo:13: 00002000:00000024:2.0:1788832750.230968:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832750.231014:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994256256:12345-0@lo:13: Request processed in 77us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832750.231029:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788832750.231488:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3989ed80 x1875726994256256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832750.231507:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994256256:0@lo:13: 00010000:00010000:3.0:1788832751.190904:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788832751.747289:0:7633:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788832751.747294:0:7633:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788832751.747436:0:7633:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff984d07487000 00000020:01000004:3.0:1788832751.747452:0:7633:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788832751.747465:0:7633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788832751.747477:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff984d06c319b8) 00000020:00000080:3.0:1788832751.747494:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788832751.776423:0:7633:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788832751.776936:0:7633:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788832751.823493:0:7633:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788832751.832523:0:7633:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788832751.832556:0:7633:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788832751.832734:0:7633:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788832751.833454:0:7633:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788832751.838885:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788832751.838901:0:7633:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788832751.838912:0:7633:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd270a10c1c6a49d5 00000020:01000004:2.0:1788832751.838920:0:7633:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788832751.838939:0:7633:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788832751.838943:0:7633:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788832751.838948:0:7633:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788832751.838969:0:7633:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788832751.838972:0:7633:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.141@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788832751.875477:0:7633:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788832751.875512:0:7633:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.141@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788832751.875517:0:7633:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788832751.875518:0:7633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788832751.875520:0:7633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832751.875521:0:7633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788832751.875522:0:7633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832751.875523:0:7633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832751.875525:0:7633:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788832751.875526:0:7633:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788832751.875527:0:7633:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788832751.875529:0:7633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832751.875531:0:7633:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788832751.875534:0:7633:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788832751.875536:0:7633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788832751.875541:0:7633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788832751.875542:0:7633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832751.875543:0:7633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788832751.875544:0:7633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832751.875545:0:7633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832751.875546:0:7633:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788832751.875547:0:7633:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788832751.875548:0:7633:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788832751.875549:0:7633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832751.875550:0:7633:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788832751.875573:0:7633:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788832751.875588:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994256384:0@lo:253: 00000100:00100000:2.0:1788832751.875656:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832751.875799:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994256384 00000100:00100000:2.0:1788832751.875804:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832751.875806:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994256384 00000100:00100000:0.0:1788832751.875854:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788832751.875863:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+16:7633:x1875726994256384:12345-0@lo:253: 20000000:01000000:0.0:1788832751.875897:0:5848:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788832751.875901:0:5848:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788832751.875906:0:5848:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788832751.875909:0:5848:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788832751.877010:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832751.877207:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788832751.877229:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788832751.877266:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788832751.877274:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788832751.877306:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788832751.877557:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788832751.877951:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788832751.877969:0:5848:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.141@tcp 20000000:01000000:0.0:1788832751.877971:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.141@tcp (null) (null) (null) 00000040:00080000:0.0:1788832751.878004:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788832751.878012:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788832751.878061:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788832751.878070:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.141@tcp (null) (null) 00000040:00080000:0.0:1788832751.878100:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788832751.878109:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788832751.878135:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788832751.878181:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788832751.879076:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788832751.879095:0:5848:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.141@tcp 20000000:01000000:0.0:1788832751.879097:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.141@tcp (null) (null) (null) 00000040:00080000:0.0:1788832751.879134:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788832751.879142:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788832751.879174:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788832751.879183:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.141@tcp (null) (null) 00000040:00080000:0.0:1788832751.879214:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788832751.879223:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788832751.879265:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788832751.879303:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788832751.879397:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788832751.879401:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788832751.879405:0:5848:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788832751.879417:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788832751.879426:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788832751.879459:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788832751.879462:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788832751.880079:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788832751.880126:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788832751.880181:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788832751.880495:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788832751.880535:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788832751.880593:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788832751.880605:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788832751.880608:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788832751.881341:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788832751.881408:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788832751.881463:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788832751.881953:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788832751.881998:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788832751.882035:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788832751.882048:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788832751.882050:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788832751.883638:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788832751.883980:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788832751.884023:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788832751.884092:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788832751.884106:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788832751.884108:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788832751.884860:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788832751.884931:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788832751.884968:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788832751.885281:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788832751.885341:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788832751.885431:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1788832751.885449:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788832751.885452:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788832751.885462:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788832751.885482:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.885502:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a492d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4926 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.885510:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4950 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.885518:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a497a expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.885532:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d00031000/0xd270a10c1c6a499d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4996 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.885538:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a49c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a49b9 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.885545:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.885583:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a49c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a49b9 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.885598:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a49c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a49b9 expref: 16 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832751.885612:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994256512:0@lo:104: 00000100:00100000:2.0:1788832751.885678:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832751.885729:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d00031000/0xd270a10c1c6a499d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4996 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.885738:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d00031000/0xd270a10c1c6a499d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4996 expref: 16 pid: 5848 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832751.885777:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994256640:0@lo:104: 00010000:00010000:2.0:1788832751.885801:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a497a expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.885809:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4981 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a497a expref: 16 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832751.885827:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994256768:0@lo:104: 00010000:00010000:2.0:1788832751.885850:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4950 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.885857:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4957 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4950 expref: 16 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832751.885864:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994256896:0@lo:104: 00010000:00010000:2.0:1788832751.885883:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a492d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4926 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.885891:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a492d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4926 expref: 16 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832751.885898:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994257024:0@lo:104: 00000100:00100000:2.0:1788832751.885913:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832751.886145:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788832751.886164:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832751.886185:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832751.886194:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832751.886203:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832751.886212:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994256512 00000100:00100000:3.0:1788832751.886218:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994256512 00000100:00100000:3.0:1788832751.886247:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994256640 00000100:00100000:3.0:1788832751.886250:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994256640 00000100:00100000:3.0:1788832751.886258:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994256768 00000100:00100000:3.0:1788832751.886260:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994256768 00000100:00100000:3.0:1788832751.886279:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994256896 00000100:00100000:3.0:1788832751.886282:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994256896 00000100:00100000:3.0:1788832751.886291:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994257024 00000100:00100000:3.0:1788832751.886299:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994257024 00000100:00100000:3.0:1788832751.886574:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788832751.886584:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+7:5848:x1875726994256512:12345-0@lo:104: 00010000:00010000:3.0:1788832751.886598:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a49c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.886881:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788832751.886887:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+7:5848:x1875726994256512:12345-0@lo:104: Request processed in 306us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832751.886892:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994256512:0@lo:104: 00000100:00100000:3.0:1788832751.886894:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788832751.886931:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788832751.886943:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+6:5848:x1875726994256640:12345-0@lo:104: 00010000:00010000:3.0:1788832751.886950:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a499d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.887000:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788832751.887006:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+6:5848:x1875726994256640:12345-0@lo:104: Request processed in 64us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832751.887012:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788832751.887025:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788832751.887030:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+5:5848:x1875726994256768:12345-0@lo:104: 00010000:00010000:3.0:1788832751.887037:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4981 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.887063:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788832751.887067:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+5:5848:x1875726994256768:12345-0@lo:104: Request processed in 38us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832751.887073:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788832751.887093:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788832751.887099:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+4:5848:x1875726994256896:12345-0@lo:104: 00010000:00010000:3.0:1788832751.887106:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4957 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.887134:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788832751.887138:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+4:5848:x1875726994256896:12345-0@lo:104: Request processed in 40us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832751.887143:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788832751.887154:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788832751.887160:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:5848:x1875726994257024:12345-0@lo:104: 00010000:00010000:3.0:1788832751.887166:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a492d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.887190:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788832751.887195:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:5848:x1875726994257024:12345-0@lo:104: Request processed in 36us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832751.887200:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788832751.887256:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994256640:0@lo:104: 00000100:00100000:1.0:1788832751.887264:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994256768:0@lo:104: 00000100:00100000:1.0:1788832751.887405:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994256896:0@lo:104: 00000100:00100000:1.0:1788832751.887415:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1875726994257024:0@lo:104: 00010000:00010000:1.0:1788832751.887441:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887500:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788832751.887506:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a49c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887513:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05800 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788832751.887517:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a49c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887525:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a49c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832751.887532:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a49c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832751.887546:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832751.887583:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a49c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887590:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788832751.887634:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994257152:0@lo:103: 00000100:00100000:1.0:1788832751.887669:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832751.887723:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a49c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887731:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d05f05800/0xd270a10c1c6a49b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a49c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887767:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788832751.887772:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a499d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887778:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d027e3c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788832751.887781:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a499d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887788:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a499d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832751.887794:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a499d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832751.887799:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832751.887814:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a499d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887820:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832751.887837:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a499d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887844:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d027e3c00/0xd270a10c1c6a4996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a499d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887855:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788832751.887859:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4981 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887864:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d027e3400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788832751.887867:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4981 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887873:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4981 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832751.887879:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4981 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832751.887884:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832751.887909:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4981 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887915:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832751.887921:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4981 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887928:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a497a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4981 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887938:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832751.887947:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4957 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887953:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d027e3600 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788832751.887956:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4957 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887963:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4957 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832751.887969:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4957 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832751.887974:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832751.887987:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4957 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.887993:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788832751.888036:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832751.888044:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994257536:0@lo:103: 00000100:00100000:1.0:1788832751.888068:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832751.888103:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994257152 00000100:00100000:1.0:1788832751.888109:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994257152 00010000:00010000:1.0:1788832751.888130:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a49c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a49b9 expref: 17 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832751.888151:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994257536 00000100:00100000:1.0:1788832751.888162:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994257536 00010000:00010000:1.0:1788832751.888177:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4957 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4950 expref: 18 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832751.888192:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832751.888199:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+18:3317:x1875726994257152:12345-0@lo:103: 00010000:00010000:1.0:1788832751.888209:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832751.888214:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a49c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a49b9 expref: 18 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.888225:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a49c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a49b9 expref: 18 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.888237:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a49c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a49b9 expref: 18 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.888250:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832751.888458:0:5839:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788832751.888467:0:5839:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788832751.888487:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994257280:0@lo:103: 00000100:00100000:3.0:1788832751.888514:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832751.888528:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832751.888533:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994257408:0@lo:103: 00000100:00100000:3.0:1788832751.888553:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832751.888624:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788832751.889148:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994257280 00000100:00100000:3.0:1788832751.889153:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994257280 00010000:00010000:3.0:1788832751.889181:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d00031000/0xd270a10c1c6a499d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4996 expref: 18 pid: 5848 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.889219:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4957 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832751.889224:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+18:3317:x1875726994257152:12345-0@lo:103: Request processed in 1026us (1555us total) trans 0 rc 0/0 00010000:00010000:2.0:1788832751.889228:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d027e3600/0xd270a10c1c6a4950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4957 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832751.889232:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788832751.889240:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832751.889242:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832751.889244:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832751.889248:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994257408 00000100:00100000:1.0:1788832751.889251:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994257408 00010000:00010000:1.0:1788832751.889262:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4981 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a497a expref: 18 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832751.889289:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788832751.889297:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+18:3317:x1875726994257536:12345-0@lo:103: 00010000:00010000:1.0:1788832751.889306:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832751.889310:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4957 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4950 expref: 18 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.889329:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4950 expref: 18 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.889341:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4957 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4950 expref: 18 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.889352:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832751.889388:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+17:3317:x1875726994257536:12345-0@lo:103: Request processed in 93us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832751.889394:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788832751.889407:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832751.889413:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+16:3314:x1875726994257408:12345-0@lo:103: 00010000:00010000:1.0:1788832751.889420:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832751.889424:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4981 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a497a expref: 16 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.889432:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a497a expref: 16 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.889442:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4981 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a497a expref: 16 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.889450:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832751.889485:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+15:3314:x1875726994257408:12345-0@lo:103: Request processed in 73us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832751.889491:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832751.889522:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994257536:0@lo:103: 00000100:00100000:1.0:1788832751.889531:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994257152:0@lo:103: 00000100:00100000:3.0:1788832751.889604:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788832751.889611:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32c45e-9a6a-4349-b87e-107522b34816+14:3314:x1875726994257280:12345-0@lo:103: 00010000:00010000:3.0:1788832751.889619:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832751.889624:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d00031000/0xd270a10c1c6a499d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4996 expref: 14 pid: 5848 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.889633:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d00031000/0xd270a10c1c6a499d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4996 expref: 14 pid: 5848 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.889643:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d00031000/0xd270a10c1c6a499d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4996 expref: 14 pid: 5848 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.889653:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832751.889677:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32c45e-9a6a-4349-b87e-107522b34816+13:3314:x1875726994257280:12345-0@lo:103: Request processed in 67us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832751.889683:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788832751.889958:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994257408:0@lo:103: 00000100:00100000:2.0:1788832751.889967:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994257280:0@lo:103: 00010000:00010000:0.0:1788832751.890237:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832751.890241:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832751.890242:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832751.890260:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a492d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.890329:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d00030a00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788832751.890333:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a492d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.890341:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a492d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832751.890349:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a492d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832751.890364:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832751.890426:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a492d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.890433:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832751.890458:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a492d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.890464:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d00030a00/0xd270a10c1c6a4926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a492d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.890477:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832751.890478:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832751.890480:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832751.890512:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832751.890524:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994257664:0@lo:103: 00000100:00100000:0.0:1788832751.890561:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832751.890667:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994257664 00000100:00100000:2.0:1788832751.890673:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994257664 00010000:00010000:2.0:1788832751.890691:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a492d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4926 expref: 13 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832751.890721:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788832751.890734:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+13:3316:x1875726994257664:12345-0@lo:103: 00010000:00010000:2.0:1788832751.890878:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832751.890884:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a492d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4926 expref: 13 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.890894:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a492d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4926 expref: 13 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.890905:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a492d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4926 expref: 13 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.890916:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.890924:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.891094:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.891102:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.891109:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.891115:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.891121:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d013d0600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788832751.891125:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.891131:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.891233:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.891242:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788832751.891251:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1788832751.891465:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.891474:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.891491:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832751.891540:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+12:3316:x1875726994257664:12345-0@lo:103: Request processed in 806us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832751.891548:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788832751.891614:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994257664:0@lo:103: 00000100:00100000:2.0:1788832751.957950:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+11:7633:x1875726994256384:12345-0@lo:253: Request processed in 82079us (82285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832751.957963:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788832751.958107:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994256384:0@lo:253: 10000000:01000000:3.0:1788832751.958121:0:7633:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788832751.958124:0:7633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788832751.958126:0:7633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788832751.958127:0:7633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832751.958128:0:7633:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788832751.958130:0:7633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832751.958131:0:7633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832751.958133:0:7633:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832751.958134:0:7633:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788832751.958135:0:7633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832751.958137:0:7633:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788832751.958159:0:7633:0:(tgt_mount.c:101:server_register_mount()) register mount ffff984d07487000 from lustre-OST0001 10000000:01000000:3.0:1788832751.958181:0:7633:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788832751.958195:0:7633:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788832751.958202:0:7633:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff984d06434d28 local copy 10000000:01000000:3.0:1788832751.958206:0:7633:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788832751.958240:0:7633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.958252:0:7633:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.958261:0:7633:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832751.958293:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994257792:0@lo:101: 00000100:00100000:3.0:1788832751.958329:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832751.958434:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994257792 00000100:00100000:2.0:1788832751.958440:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994257792 00000100:00100000:3.0:1788832751.958540:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18d00000 going to sleep for 11 seconds 00000100:00100000:2.0:1788832751.958777:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788832751.958787:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+11:7633:x1875726994257792:12345-0@lo:101: 00010000:00010000:2.0:1788832751.958807:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832751.958821:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a49e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.958843:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a49e3 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.958852:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a49e3 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832751.958861:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d013d0600, rc 0) 00000100:00100000:2.0:1788832751.958907:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:7633:x1875726994257792:12345-0@lo:101: Request processed in 121us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832751.958914:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788832751.958985:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994257792:0@lo:101: 00010000:00010000:0.0:1788832751.958999:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd270a10c1c6a49ea expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832751.959033:0:7633:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd270a10c1c6a49ea expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832751.959142:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994257920:0@lo:501: 00000100:00100000:0.0:1788832751.959172:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832751.959475:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06b930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832751.959577:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994257920 00000100:00100000:3.0:1788832751.959582:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994257920 00000100:00100000:3.0:1788832751.959608:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788832751.959616:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:7633:x1875726994257920:12345-0@lo:501: 00000100:00100000:3.0:1788832751.959858:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:7633:x1875726994257920:12345-0@lo:501: Request processed in 242us (685us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788832751.959867:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788832751.960066:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994257920:0@lo:501: 10000000:01000000:0.0:1788832751.960083:0:7633:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788832751.960111:0:7633:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788832751.960117:0:7633:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd270a10c1c6a49ea expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832751.960126:0:7633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd270a10c1c6a49ea expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832751.960132:0:7633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd270a10c1c6a49ea expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832751.960155:0:7633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788832751.960174:0:7633:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984d07487000 10000000:01000000:0.0:1788832751.960178:0:7633:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788832751.960183:0:7633:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788832751.960185:0:7633:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832751.960189:0:7633:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788832751.960192:0:7633:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788832751.960209:0:7633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832751.960228:0:7633:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832751.960237:0:7633:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832751.960252:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258048:0@lo:101: 00010000:00010000:3.0:1788832751.960373:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832751.960379:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd270a10c1c6a49ea expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.960386:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d027e3200 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1788832751.960389:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd270a10c1c6a49ea expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.960407:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd270a10c1c6a49ea expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832751.960415:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd270a10c1c6a49ea expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832751.960420:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832751.960438:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd270a10c1c6a49ea expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.960444:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832751.960463:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd270a10c1c6a49ea expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.960469:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a49e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd270a10c1c6a49ea expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.960481:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832751.960483:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832751.960485:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832751.960492:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788832751.960502:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994258176:0@lo:103: 00000100:00100000:3.0:1788832751.960530:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832751.960566:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994258176 00000100:00100000:3.0:1788832751.960570:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994258176 00000100:00100000:3.0:1788832751.960609:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832751.960617:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32c45e-9a6a-4349-b87e-107522b34816+12:3315:x1875726994258176:12345-0@lo:103: 00010000:00010000:3.0:1788832751.960639:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832751.960651:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a49ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a49e3 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.960670:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832751.960699:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32c45e-9a6a-4349-b87e-107522b34816+11:3315:x1875726994258176:12345-0@lo:103: Request processed in 83us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832751.960705:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832751.960731:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994258176:0@lo:103: 00000100:00100000:0.0:1788832751.960949:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832751.960963:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10153300 going to sleep for 11 seconds 00000100:00100000:3.0:1788832751.961114:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994258048 00000100:00100000:3.0:1788832751.961118:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994258048 00000100:00100000:3.0:1788832751.961138:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788832751.961145:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+11:7633:x1875726994258048:12345-0@lo:101: 00010000:00010000:3.0:1788832751.961154:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832751.961167:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d027e3e00/0xd270a10c1c6a49f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a49f1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.961184:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d027e3e00/0xd270a10c1c6a49f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a49f1 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.961194:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d027e3e00/0xd270a10c1c6a49f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a49f1 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.961201:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d027e3e00, rc 0) 00000100:00100000:3.0:1788832751.961238:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:7633:x1875726994258048:12345-0@lo:101: Request processed in 93us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832751.961244:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788832751.961382:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258048:0@lo:101: 00010000:00010000:0.0:1788832751.961394:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a49f8 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832751.961403:0:7633:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a49f8 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832751.961477:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258304:0@lo:501: 00000100:00100000:0.0:1788832751.961501:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832751.961530:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10153300 going to sleep for 11 seconds 00000100:00100000:3.0:1788832751.961575:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994258304 00000100:00100000:3.0:1788832751.961579:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994258304 00000100:00100000:3.0:1788832751.961594:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788832751.961600:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:7633:x1875726994258304:12345-0@lo:501: 00000100:00100000:3.0:1788832751.961867:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:7633:x1875726994258304:12345-0@lo:501: Request processed in 266us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832751.961874:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788832751.961939:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258304:0@lo:501: 00000100:00100000:0.0:1788832751.961965:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258432:0@lo:503: 00000100:00100000:0.0:1788832751.962001:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832751.962029:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10153300 going to sleep for 11 seconds 00000100:00100000:2.0:1788832751.962090:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994258432 00000100:00100000:2.0:1788832751.962094:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994258432 00000100:00100000:2.0:1788832751.962114:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788832751.962120:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:7633:x1875726994258432:12345-0@lo:503: 00000100:00100000:2.0:1788832751.962248:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+12:7633:x1875726994258432:12345-0@lo:503: Request processed in 128us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832751.962254:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788832751.962415:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258432:0@lo:503: 00000040:00080000:0.0:1788832751.962793:0:7633:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788832751.962849:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258560:0@lo:502: 00000100:00100000:0.0:1788832751.962885:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832751.962907:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10d4ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832751.962971:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994258560 00000100:00100000:3.0:1788832751.962976:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994258560 00000100:00100000:3.0:1788832751.962999:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788832751.963005:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:7633:x1875726994258560:12345-0@lo:502: 00000100:00100000:3.0:1788832751.963150:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:7633:x1875726994258560:12345-0@lo:502: Request processed in 144us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832751.963156:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788832751.963264:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258560:0@lo:502: 00000040:00080000:0.0:1788832751.963564:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788832751.963605:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788832751.963708:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788832751.963882:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788832751.963923:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788832751.963957:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788832751.963982:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258688:0@lo:502: 00000100:00100000:0.0:1788832751.964205:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832751.964277:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10153300 going to sleep for 11 seconds 00000100:00100000:3.0:1788832751.964379:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994258688 00000100:00100000:3.0:1788832751.964385:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994258688 00000100:00100000:3.0:1788832751.964462:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788832751.964471:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:7633:x1875726994258688:12345-0@lo:502: 00000100:00100000:3.0:1788832751.964631:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+12:7633:x1875726994258688:12345-0@lo:502: Request processed in 152us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832751.964638:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788832751.964712:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258688:0@lo:502: 00000040:00080000:0.0:1788832751.964814:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788832751.964824:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788832751.965389:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788832751.965396:0:7642:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788832751.965402:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832751.965404:0:7642:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788832751.965410:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832751.965423:0:7642:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff984d20344d28) 00000020:00000080:0.0:1788832751.965442:0:7642:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788832751.965448:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788832751.965512:0:7642:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984d07487000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788832751.965519:0:7642:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788832751.965525:0:7642:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd270a10c1c6a4a06 00010000:00010000:1.0:1788832751.969941:0:7642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788832751.970213:0:7642:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788832751.972530:0:7642:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788832751.972789:0:7642:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788832751.977273:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788832751.978120:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788832751.979734:0:7642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788832751.979876:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832751.979883:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832751.979885:0:7642:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788832751.979889:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832751.979892:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832751.979894:0:7642:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788832751.979897:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788832751.979899:0:7642:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788832751.979945:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832751.979949:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832751.979950:0:7642:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788832751.979964:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788832751.980108:0:7633:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788832751.980129:0:7633:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788832751.980151:0:7633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a49f8 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.980162:0:7633:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a49f8 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832751.980170:0:7633:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d07487000 from 1 10000000:01000000:1.0:1788832751.980172:0:7633:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788832751.980205:0:7633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.980212:0:7633:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.980221:0:7633:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832751.980243:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258816:0@lo:101: 00000100:00100000:1.0:1788832751.980388:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832751.980435:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832751.980489:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994258816 00000100:00100000:0.0:1788832751.980496:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994258816 00000100:00100000:0.0:1788832751.980531:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788832751.980539:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+12:7633:x1875726994258816:12345-0@lo:101: 00010000:00010000:0.0:1788832751.980551:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832751.980562:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d00030e00/0xd270a10c1c6a4a14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4a0d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832751.980583:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d00030e00/0xd270a10c1c6a4a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a0d expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832751.980593:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d00030e00/0xd270a10c1c6a4a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a0d expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832751.980602:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d00030e00, rc 0) 00000100:00100000:0.0:1788832751.980721:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:7633:x1875726994258816:12345-0@lo:101: Request processed in 181us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832751.980727:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788832751.980863:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258816:0@lo:101: 00010000:00010000:1.0:1788832751.980878:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a14 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.980886:0:7633:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4a14 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832751.980977:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258944:0@lo:501: 00000100:00100000:1.0:1788832751.981135:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832751.981164:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832751.981217:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994258944 00000100:00100000:3.0:1788832751.981222:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994258944 00000100:00100000:3.0:1788832751.981256:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788832751.981263:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:7633:x1875726994258944:12345-0@lo:501: 00000100:00100000:3.0:1788832751.981558:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:7633:x1875726994258944:12345-0@lo:501: Request processed in 294us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832751.981565:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788832751.981739:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994258944:0@lo:501: 00000100:00100000:1.0:1788832751.981801:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259072:0@lo:503: 00000100:00100000:1.0:1788832751.981836:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832751.981856:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832751.981927:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994259072 00000100:00100000:0.0:1788832751.981937:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994259072 00000100:00100000:0.0:1788832751.981965:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788832751.981972:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+13:7633:x1875726994259072:12345-0@lo:503: 00000100:00100000:0.0:1788832751.982250:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+13:7633:x1875726994259072:12345-0@lo:503: Request processed in 278us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832751.982258:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788832751.982724:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259072:0@lo:503: 00000040:00080000:2.0:1788832751.983028:0:7633:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788832751.983088:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259200:0@lo:502: 00000100:00100000:2.0:1788832751.983133:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832751.983163:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832751.984143:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994259200 00000100:00100000:3.0:1788832751.984153:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994259200 00000100:00100000:3.0:1788832751.984198:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788832751.984213:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:7633:x1875726994259200:12345-0@lo:502: 00000100:00100000:3.0:1788832751.984557:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:7633:x1875726994259200:12345-0@lo:502: Request processed in 345us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832751.984565:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788832751.984656:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259200:0@lo:502: 00000040:00080000:2.0:1788832751.985143:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788832751.985191:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788832751.985219:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259328:0@lo:502: 00000100:00100000:2.0:1788832751.985257:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832751.985294:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832751.985395:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994259328 00000100:00100000:0.0:1788832751.985400:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994259328 00000100:00100000:0.0:1788832751.985435:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788832751.985442:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:7633:x1875726994259328:12345-0@lo:502: 00000100:00100000:0.0:1788832751.985575:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:7633:x1875726994259328:12345-0@lo:502: Request processed in 132us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832751.985581:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788832751.985726:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259328:0@lo:502: 00000040:00080000:3.0:1788832751.985827:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788832751.985837:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788832751.986216:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832751.986224:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832751.986226:0:7646:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788832751.986231:0:7646:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984d07487000 00000020:00000080:2.0:1788832751.986233:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788832751.986249:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832751.986252:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832751.986253:0:7646:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788832751.986255:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788832751.986451:0:7633:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788832751.986469:0:7633:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788832751.986515:0:7633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a14 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.986526:0:7633:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a14 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832751.986560:0:7633:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788832751.986563:0:7633:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984d07487000 10000000:01000000:3.0:1788832751.986566:0:7633:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984d07487000 10000000:01000000:3.0:1788832751.986570:0:7633:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788832751.986575:0:7633:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984d07487000 from 1 10000000:01000000:3.0:1788832751.986577:0:7633:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788832751.986602:0:7633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.986609:0:7633:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832751.986618:0:7633:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832751.986653:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259456:0@lo:101: 00000100:00100000:3.0:1788832751.986690:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832751.986726:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18d006c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832751.986865:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994259456 00000100:00100000:0.0:1788832751.986872:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994259456 00000100:00100000:0.0:1788832751.986903:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788832751.986911:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:7633:x1875726994259456:12345-0@lo:101: 00010000:00010000:0.0:1788832751.986921:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832751.986933:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4a22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4a1b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832751.986953:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a1b expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832751.986963:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a1b expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832751.986971:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d00030a00, rc 0) 00000100:00100000:0.0:1788832751.987020:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+14:7633:x1875726994259456:12345-0@lo:101: Request processed in 109us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832751.987033:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788832751.987114:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259456:0@lo:101: 00010000:00010000:1.0:1788832751.987127:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a22 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.987136:0:7633:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4a22 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832751.987200:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259584:0@lo:501: 00000100:00100000:1.0:1788832751.987226:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832751.987255:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832751.987362:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994259584 00000100:00100000:2.0:1788832751.987367:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994259584 00000100:00100000:2.0:1788832751.987433:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788832751.987440:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:7633:x1875726994259584:12345-0@lo:501: 00000100:00100000:2.0:1788832751.987633:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:7633:x1875726994259584:12345-0@lo:501: Request processed in 193us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832751.987640:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788832751.987694:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259584:0@lo:501: 00000100:00100000:1.0:1788832751.987719:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259712:0@lo:503: 00000100:00100000:1.0:1788832751.987777:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832751.987966:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994259712 00000100:00100000:0.0:1788832751.987971:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994259712 00000100:00100000:0.0:1788832751.987990:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788832751.987996:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+14:7633:x1875726994259712:12345-0@lo:503: 00000100:00100000:0.0:1788832751.988126:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+14:7633:x1875726994259712:12345-0@lo:503: Request processed in 129us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832751.988133:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788832751.988173:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832751.988186:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259712:0@lo:503: 00000040:00080000:1.0:1788832751.988477:0:7633:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788832751.988524:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259840:0@lo:502: 00000100:00100000:1.0:1788832751.988551:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832751.988568:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832751.988601:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994259840 00000100:00100000:2.0:1788832751.988604:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994259840 00000100:00100000:2.0:1788832751.988625:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788832751.988631:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:7633:x1875726994259840:12345-0@lo:502: 00000100:00100000:2.0:1788832751.988963:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:7633:x1875726994259840:12345-0@lo:502: Request processed in 330us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832751.988970:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788832751.989086:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259840:0@lo:502: 00000040:00080000:1.0:1788832751.989401:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788832751.989441:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788832751.989465:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788832751.989498:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788832751.989524:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788832751.989555:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788832751.989579:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788832751.989602:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788832751.989645:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788832751.989736:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788832751.989794:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788832751.989829:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788832751.989853:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788832751.989876:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788832751.989928:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788832751.990177:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788832751.990204:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788832751.990239:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788832751.990264:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788832751.990293:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788832751.990500:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788832751.990538:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788832751.990570:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788832751.990618:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788832751.990654:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788832751.991157:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788832751.991345:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788832751.991398:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788832751.991443:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788832751.991492:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788832751.991541:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788832751.991574:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788832751.991607:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788832751.991883:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788832751.991918:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788832751.991963:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788832751.992001:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788832751.992122:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259968:0@lo:502: 00000100:00100000:1.0:1788832751.992262:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832751.992424:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832751.992465:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994259968 00000100:00100000:0.0:1788832751.992471:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994259968 00000100:00100000:0.0:1788832751.992560:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788832751.992570:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+14:7633:x1875726994259968:12345-0@lo:502: 00000100:00100000:0.0:1788832751.993173:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+14:7633:x1875726994259968:12345-0@lo:502: Request processed in 602us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832751.993182:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788832751.993410:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994259968:0@lo:502: 00000040:00080000:1.0:1788832751.993502:0:7633:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788832751.993515:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788832751.994570:0:7647:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788832751.994594:0:7647:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff984d10fb4d28) 00000020:00000080:2.0:1788832751.994614:0:7647:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788832751.994934:0:7647:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984d07487000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788832751.994939:0:7647:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984d07487000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788832751.994941:0:7647:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984d07487000 3 00010000:00080000:2.0:1788832751.994973:0:7647:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984c06633000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.141@tcp at head 00010000:00010000:2.0:1788832751.997324:0:7647:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788832751.997540:0:7647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788832751.997582:0:7647:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788832751.997594:0:7647:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd270a10c1c6a4a30 00000100:00080000:2.0:1788832751.997605:0:7647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788832751.997611:0:7647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff984c06633000 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:2.0:1788832751.997659:0:7647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984d398f8e00 x1875726994260096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788832751.997688:0:7647:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788832751.997782:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875726994260096:0@lo:38: 00000100:00100000:0.0:1788832751.997845:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832751.997917:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994260224:0@lo:400: 00000100:00100000:1.0:1788832751.997946:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832751.997977:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994260352:0@lo:400: 00000100:00100000:1.0:1788832751.998000:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832751.998024:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832751.998030:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994260480:0@lo:400: 00000100:00100000:1.0:1788832751.998054:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832751.998082:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994260096 00000100:00100000:1.0:1788832751.998089:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994260096 00000100:00100000:1.0:1788832751.998113:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994260224 00000100:00100000:1.0:1788832751.998115:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994260224 00000100:00100000:1.0:1788832751.998132:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994260352 00000100:00100000:1.0:1788832751.998135:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994260352 00000100:00100000:1.0:1788832751.998157:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832751.998172:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994260224:12345-0@lo:400: 00000100:00100000:1.0:1788832751.998221:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994260224:12345-0@lo:400: Request processed in 51us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832751.998228:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832751.998243:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788832751.998249:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994260352:12345-0@lo:400: 00000100:00100000:1.0:1788832751.998279:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994260352:12345-0@lo:400: Request processed in 30us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832751.998284:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788832751.998294:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832751.998297:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875726994260096:12345-0@lo:38: 00010000:00080000:1.0:1788832751.998314:0:5853:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1788832751.998339:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd270a10c1c6a4a37 00000004:00100000:1.0:1788832751.998353:0:5853:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788832751.998388:0:5853:0:(import.c:65:import_set_state_nolock()) ffff984c0520b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788832751.998427:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875726994260096:12345-0@lo:38: Request processed in 128us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832751.998433:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832751.998458:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994260480 00000100:00100000:1.0:1788832751.998462:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994260480 00000100:00100000:1.0:1788832751.998487:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832751.998493:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994260480:12345-0@lo:400: 00000100:00100000:1.0:1788832751.998520:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994260480:12345-0@lo:400: Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832751.998525:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788832751.998543:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832751.998551:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788832751.998572:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d0647b480 x1875726994260224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832751.998584:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994260224:0@lo:400: 00010000:00080000:1.0:1788832751.998609:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d0647a300 x1875726994260480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832751.998617:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994260480:0@lo:400: 00010000:00080000:1.0:1788832751.998625:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d06479f80 x1875726994260352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832751.998639:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994260352:0@lo:400: 00000040:00080000:1.0:1788832751.998807:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:0.0:1788832751.998823:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d398f8e00 x1875726994260096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832751.998830:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788832751.998837:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788832751.998844:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:01000000:1.0:1788832751.998845:0:7633:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00080000:0.0:1788832751.998848:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788832751.998850:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984c06633000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788832751.998854:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875726994260096:0@lo:38: 10000000:01000000:1.0:1788832751.998866:0:7633:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788832751.998878:0:7633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a22 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832751.998888:0:7633:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a22 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788832751.998930:0:7633:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788832751.998932:0:7633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788832751.998933:0:7633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832751.998934:0:7633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832751.998935:0:7633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832751.998937:0:7633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832751.998938:0:7633:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788832751.998939:0:7633:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832751.998941:0:7633:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832751.998942:0:7633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832751.998943:0:7633:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788832751.998950:0:7633:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788832751.998952:0:7633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788832751.998953:0:7633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788832751.998954:0:7633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832751.998955:0:7633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832751.998956:0:7633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832751.998957:0:7633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832751.998958:0:7633:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788832751.998959:0:7633:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832751.998960:0:7633:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832751.998961:0:7633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832751.998962:0:7633:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788832751.998975:0:7633:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788832751.998985:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06479f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994260608:0@lo:253: 00000100:00100000:1.0:1788832751.999018:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832751.999051:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c120c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832751.999099:0:7648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7648:1875726994260736:0@lo:901: 00000100:00100000:1.0:1788832751.999137:0:7648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832751.999163:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994260736 00000100:00100000:1.0:1788832751.999167:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994260736 00000100:00100000:1.0:1788832751.999198:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832751.999204:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7648:x1875726994260736:12345-0@lo:901: 00000100:00100000:0.0:1788832751.999264:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994260608 00000100:00100000:0.0:1788832751.999268:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994260608 00000100:00100000:0.0:1788832751.999290:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788832751.999295:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:7633:x1875726994260608:12345-0@lo:253: 20000000:01000000:0.0:1788832751.999313:0:5846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788832751.999325:0:5846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788832751.999510:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7648:x1875726994260736:12345-0@lo:901: Request processed in 305us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832751.999517:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788832751.999532:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832751.999593:0:7648:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12b40 going to sleep for 11 seconds 00010000:00080000:1.0:1788832751.999607:0:7648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d0647a300 x1875726994260736/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788832767 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832751.999617:0:7648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7648:1875726994260736:0@lo:901: 20000000:01000000:3.0:1788832752.041926:0:5846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788832752.041945:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788832752.041999:0:5869:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788832752.042015:0:5869:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788832752.042034:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832752.042051:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d013d0400/0xd270a10c1c6a498f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4988 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832752.042060:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832752.042093:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d013d0400/0xd270a10c1c6a498f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4988 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832752.042106:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d013d0400/0xd270a10c1c6a498f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4988 expref: 14 pid: 5846 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832752.042120:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5869:1875726994260864:0@lo:104: 00000100:00100000:1.0:1788832752.042181:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832752.042228:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12000 going to sleep for 11 seconds 00000100:00100000:2.0:1788832752.042339:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994260864 00000100:00100000:2.0:1788832752.042348:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994260864 00000100:00100000:2.0:1788832752.042405:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788832752.042413:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:5869:x1875726994260864:12345-0@lo:104: 00010000:00010000:2.0:1788832752.042425:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a498f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832752.042636:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832752.042644:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:5869:x1875726994260864:12345-0@lo:104: Request processed in 232us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832752.042652:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788832752.043010:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832752.043018:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a498f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832752.043026:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05e00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1788832752.043030:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a498f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832752.043038:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a498f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832752.043045:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a498f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832752.043058:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788832752.043092:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a498f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832752.043099:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832752.043124:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a498f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832752.043132:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a498f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832752.043148:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832752.043150:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832752.043151:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832752.043158:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832752.043168:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994260992:0@lo:103: 00000100:00100000:1.0:1788832752.043205:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832752.047033:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5869:1875726994260864:0@lo:104: 00010000:00010000:0.0:1788832752.047062:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832752.047088:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994260992 00000100:00100000:0.0:1788832752.047095:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994260992 00010000:00010000:0.0:1788832752.047124:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d013d0400/0xd270a10c1c6a498f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4988 expref: 15 pid: 5846 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832752.047153:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788832752.047162:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d08a83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32c45e-9a6a-4349-b87e-107522b34816+15:3315:x1875726994260992:12345-0@lo:103: 00010000:00010000:0.0:1788832752.047175:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832752.047179:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d013d0400/0xd270a10c1c6a498f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4988 expref: 15 pid: 5846 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832752.047189:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d013d0400/0xd270a10c1c6a498f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4988 expref: 15 pid: 5846 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832752.047205:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d0400/0xd270a10c1c6a498f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4988 expref: 15 pid: 5846 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832752.047220:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832752.047244:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788832752.047258:0:5839:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005244122s 00010000:00010000:0.0:1788832752.047263:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832752.047269:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832752.047275:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832752.047281:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832752.047287:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:0.0:1788832752.047291:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832752.047298:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832752.047312:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832752.047320:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832752.047392:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d08a83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32c45e-9a6a-4349-b87e-107522b34816+14:3315:x1875726994260992:12345-0@lo:103: Request processed in 230us (4185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832752.047400:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788832752.047458:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994260992:0@lo:103: 00010000:00010000:0.0:1788832752.047477:0:5869:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832752.047485:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832752.047491:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d05f04600/0xd270a10c1c6a4a3e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832752.050185:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+13:7633:x1875726994260608:12345-0@lo:253: Request processed in 50881us (51157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832752.050214:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788832752.050332:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06479f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd32c45e-9a6a-4349-b87e-107522b34816:7633:1875726994260608:0@lo:253: 10000000:01000000:1.0:1788832752.050347:0:7633:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788832752.050350:0:7633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788832752.050351:0:7633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788832752.050352:0:7633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832752.050363:0:7633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832752.050365:0:7633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832752.050367:0:7633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832752.050368:0:7633:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788832752.050369:0:7633:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832752.050371:0:7633:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832752.050372:0:7633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832752.050374:0:7633:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788832752.050388:0:7633:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788832752.054712:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788832752.055250:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788832752.055504:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788832752.055873:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788832752.056064:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788832752.056324:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788832752.066252:0:7633:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788832752.213079:0:7633:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788832752.213086:0:7633:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788832752.213121:0:7633:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788832752.213181:0:7633:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.141@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788832752.213196:0:7633:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788832752.213222:0:7633:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788832752.221209:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832753.240024:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788832753.495388:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788832753.495394:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984d39f1a000 from 30 10000000:01000000:1.0:1788832753.495398:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788832753.495446:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.495457:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.495467:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832753.495489:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06479f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994261120:0@lo:101: 00000100:00100000:1.0:1788832753.495551:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.495606:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832753.495847:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994261120 00000100:00100000:2.0:1788832753.495854:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994261120 00000100:00100000:2.0:1788832753.495901:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788832753.495910:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:5850:x1875726994261120:12345-0@lo:101: 00010000:00010000:2.0:1788832753.495922:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832753.495935:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4a45 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832753.495969:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a45 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832753.495979:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a45 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832753.495988:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d013d1e00, rc 0) 00000100:00100000:2.0:1788832753.496030:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994261120:12345-0@lo:101: Request processed in 121us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832753.496037:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788832753.496080:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06479f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994261120:0@lo:101: 00010000:00010000:2.0:1788832753.496094:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832753.496112:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4a4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832753.496164:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994261248:0@lo:501: 00000100:00100000:2.0:1788832753.496386:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832753.496412:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c0627ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832753.496425:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994261248 00000100:00100000:2.0:1788832753.496490:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994261248 00000100:00100000:2.0:1788832753.496515:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788832753.496521:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994261248:12345-0@lo:501: 00000100:00100000:2.0:1788832753.496864:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994261248:12345-0@lo:501: Request processed in 342us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832753.496871:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788832753.496905:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994261248:0@lo:501: 00000100:00100000:2.0:1788832753.496935:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994261376:0@lo:503: 00000100:00100000:2.0:1788832753.497526:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832753.497563:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c0627ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832753.497644:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994261376 00000100:00100000:1.0:1788832753.497650:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994261376 00000100:00100000:1.0:1788832753.497687:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788832753.497694:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994261376:12345-0@lo:503: 00000100:00100000:1.0:1788832753.498024:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994261376:12345-0@lo:503: Request processed in 330us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832753.498031:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788832753.498178:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994261376:0@lo:503: 00000100:00100000:0.0:1788832753.498715:0:7721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7721:1875726994261504:0@lo:502: 00000100:00100000:0.0:1788832753.498781:0:7721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832753.498799:0:7721:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d92840 going to sleep for 11 seconds 00000100:00100000:1.0:1788832753.498880:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994261504 00000100:00100000:1.0:1788832753.498885:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994261504 00000100:00100000:1.0:1788832753.498921:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788832753.498935:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+14:7721:x1875726994261504:12345-0@lo:502: 00000100:00100000:0.0:1788832753.499452:0:7721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7721:1875726994261504:0@lo:502: 00000100:00100000:0.0:1788832753.499496:0:7721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7721:1875726994261632:0@lo:502: 00000100:00100000:0.0:1788832753.501411:0:7721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832753.501567:0:7721:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d92840 going to sleep for 11 seconds 00000100:00100000:1.0:1788832753.503053:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+14:7721:x1875726994261504:12345-0@lo:502: Request processed in 4112us (4264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832753.503066:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788832753.503121:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994261632 00000100:00100000:1.0:1788832753.503130:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994261632 00000100:00100000:2.0:1788832753.503497:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788832753.503509:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+14:7721:x1875726994261632:12345-0@lo:502: 00000100:00100000:2.0:1788832753.504058:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+14:7721:x1875726994261632:12345-0@lo:502: Request processed in 551us (2651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832753.504067:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788832753.506894:0:7721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7721:1875726994261632:0@lo:502: 00000040:00080000:0.0:1788832753.506934:0:7721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788832753.507466:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788832753.507488:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788832753.507498:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.507510:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832753.507520:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788832753.507523:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788832753.507525:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788832753.507558:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.507566:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.507576:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832753.507594:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994261760:0@lo:101: 00000100:00100000:1.0:1788832753.507648:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.508469:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12480 going to sleep for 11 seconds 00000100:00100000:3.0:1788832753.510570:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994261760 00000100:00100000:3.0:1788832753.510581:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994261760 00000100:00100000:3.0:1788832753.510640:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788832753.510650:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994261760:12345-0@lo:101: 00010000:00010000:3.0:1788832753.510665:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832753.510681:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a4a5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4a53 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.510705:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a4a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a53 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.510777:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a4a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a53 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.510787:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d027e2600, rc 0) 00000100:00100000:3.0:1788832753.510854:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994261760:12345-0@lo:101: Request processed in 205us (3204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832753.510861:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788832753.510894:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994261760:0@lo:101: 00010000:00010000:1.0:1788832753.510921:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a5a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.510931:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4a5a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832753.511144:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994261888:0@lo:501: 00000100:00100000:1.0:1788832753.511184:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.511225:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12480 going to sleep for 11 seconds 00000100:00100000:3.0:1788832753.511346:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994261888 00000100:00100000:3.0:1788832753.511362:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994261888 00000100:00100000:3.0:1788832753.511397:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788832753.511405:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994261888:12345-0@lo:501: 00000100:00100000:3.0:1788832753.511635:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994261888:12345-0@lo:501: Request processed in 230us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832753.511642:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788832753.511717:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994261888:0@lo:501: 00000100:00100000:1.0:1788832753.511777:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994262016:0@lo:503: 00000100:00100000:1.0:1788832753.511816:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.511833:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12480 going to sleep for 11 seconds 00000100:00100000:3.0:1788832753.512425:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994262016 00000100:00100000:3.0:1788832753.512432:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994262016 00000100:00100000:3.0:1788832753.512469:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788832753.512477:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994262016:12345-0@lo:503: 00000100:00100000:3.0:1788832753.513512:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994262016:12345-0@lo:503: Request processed in 1032us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832753.513521:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788832753.513617:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994262016:0@lo:503: 00000100:00100000:3.0:1788832753.514144:0:7724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7724:1875726994262144:0@lo:502: 00000100:00100000:3.0:1788832753.514198:0:7724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832753.514235:0:7724:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18d00600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832753.514277:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994262144 00000100:00100000:1.0:1788832753.514293:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994262144 00000100:00100000:1.0:1788832753.514329:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788832753.514336:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+15:7724:x1875726994262144:12345-0@lo:502: 00000100:00100000:1.0:1788832753.514561:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+15:7724:x1875726994262144:12345-0@lo:502: Request processed in 225us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832753.514569:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788832753.514690:0:7724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7724:1875726994262144:0@lo:502: 00000020:01000000:3.0:1788832753.514714:0:7724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832753.514722:0:7724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832753.514724:0:7724:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788832753.514729:0:7724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788832753.514731:0:7724:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788832753.514779:0:7724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7724:1875726994262272:0@lo:502: 00000100:00100000:3.0:1788832753.514812:0:7724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832753.514838:0:7724:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18d00600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832753.514961:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994262272 00000100:00100000:1.0:1788832753.514966:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994262272 00000100:00100000:1.0:1788832753.515000:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788832753.515007:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+15:7724:x1875726994262272:12345-0@lo:502: 00000100:00100000:1.0:1788832753.515139:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+15:7724:x1875726994262272:12345-0@lo:502: Request processed in 132us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832753.515151:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788832753.515289:0:7724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7724:1875726994262272:0@lo:502: 00000020:01000000:3.0:1788832753.515310:0:7724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832753.515315:0:7724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832753.515317:0:7724:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788832753.515320:0:7724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788832753.515515:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788832753.515532:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788832753.515541:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a5a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.515552:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a5a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832753.515562:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788832753.515565:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984d2a26c800 from 30 10000000:01000000:1.0:1788832753.515568:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788832753.515589:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.515598:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.515606:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832753.515618:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994262400:0@lo:101: 00000100:00100000:1.0:1788832753.515646:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.515669:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832753.515713:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994262400 00000100:00100000:3.0:1788832753.515718:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994262400 00000100:00100000:3.0:1788832753.515810:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788832753.515819:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994262400:12345-0@lo:101: 00010000:00010000:3.0:1788832753.515828:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832753.515840:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d027e3600/0xd270a10c1c6a4a68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4a61 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.515859:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d027e3600/0xd270a10c1c6a4a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a61 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.515869:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d027e3600/0xd270a10c1c6a4a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a61 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.515878:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d027e3600, rc 0) 00000100:00100000:3.0:1788832753.515946:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994262400:12345-0@lo:101: Request processed in 128us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832753.515952:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788832753.516002:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994262400:0@lo:101: 00010000:00010000:1.0:1788832753.516014:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.516022:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4a68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832753.516067:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994262528:0@lo:501: 00000100:00100000:1.0:1788832753.516090:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.516149:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832753.516179:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994262528 00000100:00100000:3.0:1788832753.516183:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994262528 00000100:00100000:3.0:1788832753.516274:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788832753.516343:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994262528:12345-0@lo:501: 00000100:00100000:3.0:1788832753.516580:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994262528:12345-0@lo:501: Request processed in 299us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832753.516587:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788832753.516640:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994262528:0@lo:501: 00000100:00100000:1.0:1788832753.516666:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994262656:0@lo:503: 00000100:00100000:1.0:1788832753.516698:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.516768:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832753.516808:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994262656 00000100:00100000:3.0:1788832753.516812:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994262656 00000100:00100000:3.0:1788832753.516865:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788832753.516871:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994262656:12345-0@lo:503: 00000100:00100000:3.0:1788832753.517010:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994262656:12345-0@lo:503: Request processed in 139us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832753.517017:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788832753.517093:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994262656:0@lo:503: 00000100:00100000:0.0:1788832753.517446:0:7725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7725:1875726994262784:0@lo:502: 00000100:00100000:0.0:1788832753.517549:0:7725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832753.517576:0:7725:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d92840 going to sleep for 11 seconds 00000100:00100000:2.0:1788832753.517972:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994262784 00000100:00100000:2.0:1788832753.517985:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994262784 00000100:00100000:2.0:1788832753.518019:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788832753.518028:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+16:7725:x1875726994262784:12345-0@lo:502: 00000100:00100000:2.0:1788832753.518232:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+16:7725:x1875726994262784:12345-0@lo:502: Request processed in 204us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832753.518239:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788832753.518259:0:7725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7725:1875726994262784:0@lo:502: 00000100:00100000:1.0:1788832753.518345:0:7725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7725:1875726994262912:0@lo:502: 00000100:00100000:1.0:1788832753.518415:0:7725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.518452:0:7725:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832753.518490:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994262912 00000100:00100000:3.0:1788832753.518495:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994262912 00000100:00100000:3.0:1788832753.518527:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788832753.518534:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+16:7725:x1875726994262912:12345-0@lo:502: 00000100:00100000:3.0:1788832753.518690:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+16:7725:x1875726994262912:12345-0@lo:502: Request processed in 156us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832753.518697:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788832753.519220:0:7725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7725:1875726994262912:0@lo:502: 00000040:00080000:2.0:1788832753.519245:0:7725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788832753.521281:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788832753.521312:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788832753.521323:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.521405:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832753.521416:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788832753.521419:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984d2a26c800 from 5 10000000:01000000:3.0:1788832753.521421:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788832753.521455:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.521463:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.521474:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832753.521502:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994263040:0@lo:101: 00000100:00100000:3.0:1788832753.521556:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832753.521595:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06b93540 going to sleep for 11 seconds 00000100:00100000:2.0:1788832753.521849:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994263040 00000100:00100000:2.0:1788832753.521856:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994263040 00000100:00100000:2.0:1788832753.521902:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788832753.521911:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994263040:12345-0@lo:101: 00010000:00010000:2.0:1788832753.521923:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832753.521937:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d013d0c00/0xd270a10c1c6a4a76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4a6f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832753.521959:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d0c00/0xd270a10c1c6a4a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a6f expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832753.521973:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d013d0c00/0xd270a10c1c6a4a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a6f expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832753.521981:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d013d0c00, rc 0) 00000100:00100000:2.0:1788832753.522028:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994263040:12345-0@lo:101: Request processed in 119us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832753.522035:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788832753.522107:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994263040:0@lo:101: 00010000:00010000:1.0:1788832753.522121:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.522129:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832753.522176:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994263168:0@lo:256: 00000100:00100000:1.0:1788832753.522207:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.522298:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832753.522329:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994263168 00000100:00100000:2.0:1788832753.522334:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994263168 00000100:00100000:2.0:1788832753.522403:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788832753.522410:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994263168:12345-0@lo:256: 20000000:01000000:2.0:1788832753.522422:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788832753.522436:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788832753.522438:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788832753.522502:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994263168:12345-0@lo:256: Request processed in 92us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832753.522508:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788832753.522558:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994263168:0@lo:256: 10000000:01000000:1.0:1788832753.522596:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788832753.522602:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.522613:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832753.522620:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788832753.522622:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788832753.522624:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788832753.522639:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.522645:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.522652:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832753.522662:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994263296:0@lo:101: 00000100:00100000:1.0:1788832753.522684:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.522734:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832753.522918:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994263296 00000100:00100000:3.0:1788832753.522924:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994263296 00000100:00100000:3.0:1788832753.522946:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788832753.522952:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994263296:12345-0@lo:101: 00010000:00010000:3.0:1788832753.522960:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832753.523373:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a4a84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4a7d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.523394:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a4a84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a7d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.523404:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a4a84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a7d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.523411:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d027e3c00, rc 0) 00000100:00100000:3.0:1788832753.523452:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994263296:12345-0@lo:101: Request processed in 500us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832753.523458:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788832753.523534:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994263296:0@lo:101: 00010000:00010000:1.0:1788832753.523546:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a84 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.523555:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4a84 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832753.523600:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994263424:0@lo:501: 00000100:00100000:1.0:1788832753.523625:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.523661:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832753.523672:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994263424 00000100:00100000:1.0:1788832753.523676:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994263424 00000100:00100000:1.0:1788832753.523695:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788832753.523700:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994263424:12345-0@lo:501: 00000100:00100000:1.0:1788832753.523932:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994263424:12345-0@lo:501: Request processed in 231us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832753.523941:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788832753.523964:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994263424:0@lo:501: 00000100:00100000:1.0:1788832753.523985:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994263552:0@lo:503: 00000100:00100000:1.0:1788832753.524014:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.524024:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c12e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832753.524033:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994263552 00000100:00100000:1.0:1788832753.524036:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994263552 00000100:00100000:1.0:1788832753.524050:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788832753.524055:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994263552:12345-0@lo:503: 00000100:00100000:1.0:1788832753.524310:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994263552:12345-0@lo:503: Request processed in 254us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832753.524315:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788832753.524345:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994263552:0@lo:503: 00000100:00100000:1.0:1788832753.524513:0:7726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7726:1875726994263680:0@lo:502: 00000100:00100000:1.0:1788832753.524539:0:7726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.524554:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994263680 00000100:00100000:1.0:1788832753.524557:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994263680 00000100:00100000:1.0:1788832753.524571:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788832753.524577:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:7726:x1875726994263680:12345-0@lo:502: 00000100:00100000:1.0:1788832753.524805:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:7726:x1875726994263680:12345-0@lo:502: Request processed in 228us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832753.524812:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788832753.524834:0:7726:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d08bce300 going to sleep for 11 seconds 00000100:00100000:1.0:1788832753.524844:0:7726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7726:1875726994263680:0@lo:502: 00000020:01000000:1.0:1788832753.524863:0:7726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788832753.524870:0:7726:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788832753.524876:0:7726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832753.524878:0:7726:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788832753.524887:0:7726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788832753.524891:0:7726:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.141@tcp to nid 0x20000c0a8ce8d (192.168.206.141@tcp) 00000020:01000000:1.0:1788832753.524973:0:7726:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788832753.524976:0:7726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788832753.524989:0:7726:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff984d06483370) 00000020:00000080:1.0:1788832753.525115:0:7726:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788832753.525123:0:7726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788832753.525184:0:7726:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788832753.525190:0:7726:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788832753.525196:0:7726:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a4a92 00010000:00080000:1.0:1788832753.525220:0:7726:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984d38bb1000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.141@tcp at head 00010000:00010000:1.0:1788832753.525482:0:7726:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788832753.526030:0:7726:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788832753.526042:0:7726:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788832753.526721:0:7726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832753.527158:0:7726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832753.527210:0:7726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788832753.527270:0:7726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788832753.527644:0:7728:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788832753.527649:0:7728:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788832753.528899:0:7726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788832753.528909:0:7726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788832753.528951:0:7726:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788832753.528972:0:7726:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd270a10c1c6a4a99 00000100:00080000:1.0:1788832753.528983:0:7726:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832753.528988:0:7726:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff984d38bb1000 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:1.0:1788832753.529019:0:7726:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984d06478700 x1875726994263808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832753.529042:0:7726:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788832753.529130:0:7726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832753.529135:0:7726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832753.529136:0:7726:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788832753.529139:0:7726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832753.529143:0:7726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832753.529144:0:7726:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788832753.529147:0:7726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788832753.529149:0:7726:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788832753.529186:0:7726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7726:1875726994263936:0@lo:502: 00000100:00100000:1.0:1788832753.529255:0:7726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.529290:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994263936 00000100:00100000:1.0:1788832753.529296:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994263936 00000100:00100000:1.0:1788832753.529331:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788832753.529340:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:7726:x1875726994263936:12345-0@lo:502: 00000100:00100000:1.0:1788832753.529547:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:7726:x1875726994263936:12345-0@lo:502: Request processed in 208us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832753.529555:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788832753.529615:0:7726:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832753.529631:0:7726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:7726:1875726994263936:0@lo:502: 00000020:01000000:1.0:1788832753.529652:0:7726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832753.529656:0:7726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832753.529658:0:7726:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788832753.529665:0:7726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788832753.529708:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788832753.529722:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788832753.529731:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a84 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.529740:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a84 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832753.529858:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994263808:0@lo:8: 00000100:00100000:3.0:1788832753.529893:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832753.529933:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994263808 00000100:00100000:3.0:1788832753.529937:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994263808 00000100:00100000:3.0:1788832753.529966:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788832753.529971:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1875726994263808:12345-0@lo:8: 00010000:00080000:3.0:1788832753.529991:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:3.0:1788832753.530013:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd270a10c1c6a4aa0 00002000:00100000:3.0:1788832753.530027:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff984d3de72000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788832753.530031:0:6698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788832753.530034:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788832753.530132:0:6698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788832753.530273:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788832753.530294:0:6698:0:(import.c:65:import_set_state_nolock()) ffff984d3de76000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832753.530334:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875726994263808:12345-0@lo:8: Request processed in 361us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832753.530341:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788832753.530381:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d06478700 x1875726994263808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788832763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832753.530391:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832753.530396:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788832753.530403:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788832753.530407:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788832753.530409:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d38bb1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788832753.530418:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788832753.530423:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994263808:0@lo:8: 00000004:00080000:3.0:1788832753.530442:0:7728:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788832753.530521:0:7728:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 257220776861ns, next at 0ns, rc = 0 10000000:01000000:1.0:1788832753.530637:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788832753.530640:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff984d06434d28 from 1 10000000:01000000:1.0:1788832753.530643:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788832753.530666:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.530675:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.530698:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832753.530712:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994264064:0@lo:101: 00000100:00100000:1.0:1788832753.530739:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.530902:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832753.531732:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994264064 00000100:00100000:3.0:1788832753.531740:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994264064 00000100:00100000:3.0:1788832753.531799:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788832753.531814:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994264064:12345-0@lo:101: 00010000:00010000:3.0:1788832753.531824:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832753.531836:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4aae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4aa7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.531858:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4aa7 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.531868:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4aa7 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.531875:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d027e2e00, rc 0) 00000100:00100000:3.0:1788832753.531917:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994264064:12345-0@lo:101: Request processed in 104us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832753.531923:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788832753.533140:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832753.533159:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994264192:0@lo:400: 00000100:00100000:2.0:1788832753.533212:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832753.533249:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994264192 00000100:00100000:2.0:1788832753.533255:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994264192 00000100:00100000:2.0:1788832753.533287:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788832753.533294:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994264192:12345-0@lo:400: 00000100:00100000:2.0:1788832753.533332:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994264192:12345-0@lo:400: Request processed in 39us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832753.533341:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788832753.533391:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398fb100 x1875726994264192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832753.533403:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994264192:0@lo:400: 00000100:00100000:2.0:1788832753.533442:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994264320:0@lo:400: 00000100:00100000:2.0:1788832753.533469:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832753.533499:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994264320 00000100:00100000:2.0:1788832753.533503:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994264320 00000100:00100000:2.0:1788832753.533532:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788832753.533539:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994264320:12345-0@lo:400: 00000100:00100000:1.0:1788832753.539035:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994264064:0@lo:101: 00010000:00010000:1.0:1788832753.539063:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4aae expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832753.539076:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4aae expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832753.539166:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994264448:0@lo:501: 00000100:00100000:2.0:1788832753.539196:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994264320:12345-0@lo:400: Request processed in 5654us (5722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832753.539210:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788832753.539219:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788832753.539245:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832753.539260:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9fa80 going to sleep for 11 seconds 00010000:00080000:2.0:1788832753.539359:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398fb100 x1875726994264320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832753.539372:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994264320:0@lo:400: 00000100:00100000:2.0:1788832753.539423:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832753.539440:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994264576:0@lo:400: 00000100:00100000:2.0:1788832753.539471:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832753.539560:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994264576 00000100:00100000:2.0:1788832753.539566:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994264576 00000100:00100000:2.0:1788832753.539621:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788832753.539632:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994264576:12345-0@lo:400: 00000100:00100000:2.0:1788832753.539687:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994264576:12345-0@lo:400: Request processed in 57us (214us total) trans 0 rc 0/0 00000100:00080000:1.0:1788832753.539688:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832753.539696:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788832753.539734:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398fb100 x1875726994264576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832753.539850:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994264576:0@lo:400: 00000100:00100000:2.0:1788832753.539908:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994264704:0@lo:400: 00000100:00100000:2.0:1788832753.539953:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832753.539980:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994264704 00000100:00100000:1.0:1788832753.539986:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994264704 00000100:00100000:3.0:1788832753.540027:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994264448 00000100:00100000:3.0:1788832753.540032:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994264448 00000100:00100000:3.0:1788832753.540059:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788832753.540066:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994264448:12345-0@lo:501: 00000100:00100000:1.0:1788832753.540136:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832753.540147:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994264704:12345-0@lo:400: 00000100:00100000:1.0:1788832753.540203:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994264704:12345-0@lo:400: Request processed in 58us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832753.540210:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788832753.540226:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398fb100 x1875726994264704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788832753.540231:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832753.540240:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994264704:0@lo:400: 00000100:00100000:3.0:1788832753.540248:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994264448:12345-0@lo:501: Request processed in 181us (1028us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788832753.540259:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788832753.540295:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994264448:0@lo:501: 10000000:01000000:3.0:1788832753.540320:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788832753.540328:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4aae expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832753.540338:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4aae expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788832753.581150:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788832753.583031:0:7729:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788832753.583060:0:7729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7729:1875726994264960:0@lo:7: 00000100:00100000:3.0:1788832753.583122:0:7729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832753.583149:0:7729:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06ba33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832753.583169:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832753.583181:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994264832:0@lo:13: 00000100:00100000:3.0:1788832753.583218:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832753.583247:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994264960 00000100:00100000:3.0:1788832753.583253:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994264960 00000100:00100000:3.0:1788832753.583300:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788832753.583308:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7729:x1875726994264960:12345-0@lo:7: 00000100:00080000:0.0:1788832753.585016:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832753.585058:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994264832 00000100:00100000:0.0:1788832753.585066:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994264832 00000100:00100000:0.0:1788832753.585122:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788832753.585131:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875726994264832:12345-0@lo:13: 00002000:00000024:0.0:1788832753.585154:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788832753.585223:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875726994264832:12345-0@lo:13: Request processed in 93us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832753.585231:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788832753.591869:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3bd57100 x1875726994264832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832753.591894:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994264832:0@lo:13: 00002000:00080000:3.0:1788832753.604117:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788832753.604125:0:6700:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788832753.604885:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7729:x1875726994264960:12345-0@lo:7: Request processed in 21572us (21758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832753.604898:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788832753.604961:0:7729:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3bd54700 x1875726994264960/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788832769 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832753.604976:0:7729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7729:1875726994264960:0@lo:7: 00000004:00080000:2.0:1788832753.604989:0:7729:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788832753.605023:0:7729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7729:1875726994265088:0@lo:5: 00000100:00100000:2.0:1788832753.605059:0:7729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832753.605121:0:7729:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832753.605276:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994265088 00000100:00100000:3.0:1788832753.605282:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994265088 00000100:00100000:3.0:1788832753.605323:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788832753.605331:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7729:x1875726994265088:12345-0@lo:5: 00002000:00080000:3.0:1788832753.605659:0:6698:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788832753.605664:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788832753.606035:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7729:x1875726994265088:12345-0@lo:5: Request processed in 702us (973us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788832753.606043:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788832753.606172:0:7729:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398fb100 x1875726994265088/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832769 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832753.606187:0:7729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7729:1875726994265088:0@lo:5: 00000004:00080000:2.0:1788832753.606197:0:7729:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788832753.606223:0:7729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7729:1875726994265216:0@lo:700: 00000100:00100000:2.0:1788832753.606252:0:7729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832753.606277:0:7729:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832753.607780:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994265216 00000100:00100000:3.0:1788832753.607797:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994265216 00000100:00100000:3.0:1788832753.607848:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832753.607856:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7729:x1875726994265216:12345-0@lo:700: 00000100:00100000:3.0:1788832753.607897:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a572a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6707:1875726994265344:0@lo:700: 00000100:00100000:3.0:1788832753.607945:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832753.607966:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06ba39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832753.608206:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994265344 00000100:00100000:0.0:1788832753.608212:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994265344 00000100:00100000:0.0:1788832753.608295:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832753.608304:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6707:x1875726994265344:12345-0@lo:700: 40000000:02000000:0.0:1788832753.637485:0:5860:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788832753.645016:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6707:x1875726994265344:12345-0@lo:700: Request processed in 36704us (37061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832753.645030:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788832753.645064:0:6707:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a572a00 x1875726994265344/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788832769 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832753.645079:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a572a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6707:1875726994265344:0@lo:700: 40000000:02000000:3.0:1788832753.645091:0:6707:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1788832753.742882:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7729:x1875726994265216:12345-0@lo:700: Request processed in 135018us (136621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832753.742897:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:1.0:1788832753.743177:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788832753.743188:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1788832753.743277:0:7729:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398f8380 x1875726994265216/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788832769 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832753.743292:0:7729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7729:1875726994265216:0@lo:700: 00000004:02000040:2.0:1788832753.794213:0:7729:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788832753.804946:0:7729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7729:1875726994265472:0@lo:5: 00000100:00100000:2.0:1788832753.805019:0:7729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832753.805084:0:7729:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832753.805196:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994265472 00000100:00100000:3.0:1788832753.805204:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994265472 00000100:00100000:3.0:1788832753.805259:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788832753.805269:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7729:x1875726994265472:12345-0@lo:5: 00002000:00080000:0.0:1788832753.815008:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788832753.815027:0:6700:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788832753.819278:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7729:x1875726994265472:12345-0@lo:5: Request processed in 14003us (14251us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788832753.819295:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788832753.819377:0:7729:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398f8380 x1875726994265472/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832769 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832753.819391:0:7729:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788832753.819479:0:7729:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff984d398f8380 x1875726994265472/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832769 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832753.819491:0:7729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7729:1875726994265472:0@lo:5: 00000004:00080000:2.0:1788832753.819504:0:7729:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788832754.262227:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832755.288870:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832755.350209:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832755.350245:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994265600:0@lo:13: 00000100:00100000:1.0:1788832755.350357:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832755.350555:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994265600 00000100:00100000:0.0:1788832755.350567:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994265600 00000100:00100000:0.0:1788832755.350648:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832755.350660:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994265600:12345-0@lo:13: 00002000:00000024:0.0:1788832755.350708:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832755.350803:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994265600:12345-0@lo:13: Request processed in 146us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832755.350843:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788832755.350853:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3989d500 x1875726994265600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832755.350878:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994265600:0@lo:13: 00000100:00080000:1.0:1788832755.351235:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788832756.310008:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832757.334087:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832758.357928:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788832758.495311:0:7996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788832758.933908:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832758.933932:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994265728:0@lo:13: 00000100:00100000:2.0:1788832758.934008:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832758.934074:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994265728 00000100:00100000:0.0:1788832758.934083:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994265728 00000100:00100000:0.0:1788832758.934178:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832758.934189:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875726994265728:12345-0@lo:13: 00002000:00000024:0.0:1788832758.934221:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832758.934267:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875726994265728:12345-0@lo:13: Request processed in 80us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832758.934274:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788832758.934349:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788832758.934377:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398fb100 x1875726994265728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832758.934396:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994265728:0@lo:13: 00000100:00100000:0.0:1788832758.935812:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994265856:0@lo:400: 00000100:00100000:0.0:1788832758.935864:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832758.935899:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994266368:0@lo:400: 00000100:00100000:0.0:1788832758.935937:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832758.935968:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832758.935974:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994265984:0@lo:400: 00000100:00100000:3.0:1788832758.936111:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994266368 00000100:00100000:3.0:1788832758.936119:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994266368 00000100:00100000:3.0:1788832758.936165:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788832758.936172:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994266368:12345-0@lo:400: 00000100:00100000:3.0:1788832758.936228:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994266368:12345-0@lo:400: Request processed in 56us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832758.936235:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788832758.936317:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832758.936342:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994266112:0@lo:400: 00000100:00100000:2.0:1788832758.936372:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832758.936392:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832758.936397:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994266240:0@lo:400: 00000100:00100000:3.0:1788832758.936457:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994266112 00000100:00100000:3.0:1788832758.936461:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994266112 00000100:00100000:2.0:1788832758.936464:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832758.936488:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788832758.936495:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994266112:12345-0@lo:400: 00000100:00100000:3.0:1788832758.941422:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994266112:12345-0@lo:400: Request processed in 4919us (5040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832758.941435:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788832758.944022:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994266240 00000100:00100000:2.0:1788832758.944035:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994266240 00000100:00100000:2.0:1788832758.944094:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832758.944111:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994266240:12345-0@lo:400: 00000100:00100000:2.0:1788832758.944188:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994266240:12345-0@lo:400: Request processed in 78us (7722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832758.944194:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788832758.944217:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832758.944221:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788832758.944353:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a570700 x1875726994266240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832758.944367:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994266240:0@lo:400: 00010000:00080000:2.0:1788832758.944380:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a572d80 x1875726994266112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832758.944387:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994266112:0@lo:400: 00000100:00100000:2.0:1788832758.944466:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788832758.944501:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a573100 x1875726994266368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832758.948283:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994266368:0@lo:400: 00000100:00100000:2.0:1788832758.948396:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994265984 00000100:00100000:2.0:1788832758.948405:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994265984 00000100:00100000:2.0:1788832758.948454:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788832758.948464:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994265984:12345-0@lo:400: 00000100:00100000:2.0:1788832758.949488:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994265984:12345-0@lo:400: Request processed in 1022us (5018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832758.949603:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788832758.949651:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a570a80 x1875726994265984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832758.949677:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994265984:0@lo:400: 00000100:00100000:2.0:1788832758.950269:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994265856 00000100:00100000:2.0:1788832758.950277:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994265856 00000100:00100000:2.0:1788832758.950307:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788832758.950315:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994265856:12345-0@lo:400: 00000100:00100000:2.0:1788832758.950373:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994265856:12345-0@lo:400: Request processed in 59us (14509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832758.950380:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788832758.962490:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994265856:0@lo:400: 00000001:00080000:1.0:1788832759.025135:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788832759.397356:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832760.406099:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832760.474494:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994266496:0@lo:13: 00000100:00100000:2.0:1788832760.474564:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832760.474770:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994266496 00000100:00100000:0.0:1788832760.474779:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994266496 00000100:00100000:0.0:1788832760.474893:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788832760.474904:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994266496:12345-0@lo:13: 00002000:00000024:0.0:1788832760.474936:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832760.474994:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994266496:12345-0@lo:13: Request processed in 92us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832760.475001:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788832760.475080:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3989ce00 x1875726994266496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832760.475097:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994266496:0@lo:13: 00000100:00080000:2.0:1788832760.475479:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788832761.431147:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832762.455701:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832763.477991:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832764.054727:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832764.054896:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994266624:0@lo:13: 00000100:00100000:1.0:1788832764.054971:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832764.060027:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875726994267008:0@lo:400: 00000100:00100000:2.0:1788832764.060085:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832764.060117:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832764.060123:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994266880:0@lo:400: 00000100:00100000:2.0:1788832764.060142:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832764.060167:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994267008 00000100:00100000:2.0:1788832764.060173:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994267008 00000100:00100000:2.0:1788832764.060214:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994266880 00000100:00100000:2.0:1788832764.060217:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994266880 00000100:00100000:2.0:1788832764.060247:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788832764.060254:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875726994267008:12345-0@lo:400: 00000100:00100000:2.0:1788832764.060311:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875726994267008:12345-0@lo:400: Request processed in 57us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832764.060327:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788832764.060344:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788832764.060350:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994266880:12345-0@lo:400: 00000100:00100000:2.0:1788832764.060376:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994266880:12345-0@lo:400: Request processed in 26us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832764.060381:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788832764.060399:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832764.060415:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994267136:0@lo:400: 00000100:00100000:2.0:1788832764.060439:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832764.060458:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788832764.060464:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994266752:0@lo:400: 00000100:00100000:2.0:1788832764.060489:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832764.060516:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994267264:0@lo:400: 00000100:00100000:2.0:1788832764.060535:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832764.061813:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994266752 00000100:00100000:2.0:1788832764.061824:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994266752 00000100:00100000:2.0:1788832764.061869:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788832764.061878:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994266752:12345-0@lo:400: 00000100:00100000:2.0:1788832764.061936:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994266752:12345-0@lo:400: Request processed in 59us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832764.061943:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788832764.061994:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994266752:0@lo:400: 00010000:00080000:2.0:1788832764.062025:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398fb480 x1875726994266880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832764.062036:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994266880:0@lo:400: 00010000:00080000:2.0:1788832764.062060:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3bd54700 x1875726994267008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832764.062069:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875726994267008:0@lo:400: 00000100:00100000:2.0:1788832764.062091:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994267264 00000100:00100000:2.0:1788832764.062095:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994267264 00000100:00100000:2.0:1788832764.062124:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788832764.062131:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994267264:12345-0@lo:400: 00000100:00100000:2.0:1788832764.062165:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994267264:12345-0@lo:400: Request processed in 35us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832764.062171:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788832764.062189:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788832764.062206:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a9bf100 x1875726994267264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832764.062215:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994267264:0@lo:400: 00000100:00100000:3.0:1788832764.064864:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994267136 00000100:00100000:3.0:1788832764.064876:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994267136 00000100:00100000:3.0:1788832764.064931:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788832764.064941:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994267136:12345-0@lo:400: 00000100:00100000:3.0:1788832764.065020:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994267136:12345-0@lo:400: Request processed in 81us (4579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832764.065027:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788832764.065084:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994266624 00000100:00100000:3.0:1788832764.065089:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994266624 00000100:00100000:3.0:1788832764.065123:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788832764.065130:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994266624:12345-0@lo:13: 00002000:00000024:3.0:1788832764.065157:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832764.065192:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994266624:12345-0@lo:13: Request processed in 62us (10220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832764.065209:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788832764.068117:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832764.068124:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788832764.068169:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3bd57100 x1875726994267136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832764.068185:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994267136:0@lo:400: 00010000:00080000:1.0:1788832764.068800:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d0647b800 x1875726994266624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832764.068810:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788832764.068829:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994266624:0@lo:13: 00000100:00100000:0.0:1788832764.389906:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832764.391799:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975369344 00000100:00100000:2.0:1788832764.391812:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975369344 00000100:00100000:2.0:1788832764.391851:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 111 00000100:00100000:2.0:1788832764.391859:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2356:x1875726975369344:12345-192.168.206.41@tcp:250: 00010000:00080000:2.0:1788832764.391886:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 63388d3c-7517-4e8a-8a8f-97b1dbf6d67d@192.168.206.41@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:2.0:1788832764.391911:0:5846:0:(genops.c:1385:class_connect()) connect: client 63388d3c-7517-4e8a-8a8f-97b1dbf6d67d, cookie 0xd270a10c1c6a4ab5 00000100:00080000:2.0:1788832764.392043:0:5846:0:(import.c:65:import_set_state_nolock()) ffff984c06630000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832764.392106:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+5:2356:x1875726975369344:12345-192.168.206.41@tcp:250: Request processed in 245us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832764.392114:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 111 00000100:00100000:0.0:1788832764.419904:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832764.419988:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975369472 00000100:00100000:1.0:1788832764.419998:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975369472 00000100:00100000:1.0:1788832764.420050:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 112 00000100:00100000:1.0:1788832764.420060:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+5:5583:x1875726975369472:12345-192.168.206.41@tcp:101: 00010000:00010000:1.0:1788832764.420075:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832764.420092:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d05f05c00/0xd270a10c1c6a4abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b552ca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832764.420118:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d05f05c00/0xd270a10c1c6a4abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552ca expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832764.420129:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d05f05c00/0xd270a10c1c6a4abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552ca expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832764.420138:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05c00, rc 0) 00000100:00100000:1.0:1788832764.420184:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+6:5583:x1875726975369472:12345-192.168.206.41@tcp:101: Request processed in 126us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832764.420192:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 112 00000100:00100000:3.0:1788832764.423930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832764.424893:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975369600 00000100:00100000:0.0:1788832764.424916:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975369600 00000100:00100000:0.0:1788832764.424960:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 113 00000100:00100000:0.0:1788832764.424970:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+6:5583:x1875726975369600:12345-192.168.206.41@tcp:501: 00000100:00100000:0.0:1788832764.425518:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+6:5583:x1875726975369600:12345-192.168.206.41@tcp:501: Request processed in 547us (1593us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788832764.425528:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 113 00000100:00100000:1.0:1788832764.438817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832764.438886:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975369728 00000100:00100000:2.0:1788832764.438896:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975369728 00000100:00100000:2.0:1788832764.438948:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 114 00000100:00100000:2.0:1788832764.438958:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+6:5583:x1875726975369728:12345-192.168.206.41@tcp:101: 00010000:00010000:2.0:1788832764.438974:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832764.438989:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a4ac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b552d1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832764.439016:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a4ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552d1 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832764.439027:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a4ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552d1 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832764.439036:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d013d0600, rc 0) 00000100:00100000:2.0:1788832764.439091:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+7:5583:x1875726975369728:12345-192.168.206.41@tcp:101: Request processed in 134us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832764.439097:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 114 00000100:00100000:2.0:1788832764.440977:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832764.441116:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975369856 00000100:00100000:3.0:1788832764.441124:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975369856 00000100:00100000:3.0:1788832764.441170:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 115 00000100:00100000:3.0:1788832764.441180:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+7:5583:x1875726975369856:12345-192.168.206.41@tcp:501: 00000100:00100000:3.0:1788832764.441822:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:5583:x1875726975369856:12345-192.168.206.41@tcp:501: Request processed in 641us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832764.441831:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 115 00000100:00100000:3.0:1788832764.446916:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832764.447007:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975369984 00000100:00100000:1.0:1788832764.447017:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975369984 00000100:00100000:1.0:1788832764.447071:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 116 00000100:00100000:1.0:1788832764.447081:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:5583:x1875726975369984:12345-192.168.206.41@tcp:503: 00000100:00100000:1.0:1788832764.447768:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:5583:x1875726975369984:12345-192.168.206.41@tcp:503: Request processed in 661us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832764.447778:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 116 00000100:00100000:2.0:1788832764.467849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832764.468003:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975370112 00000100:00100000:3.0:1788832764.468013:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975370112 00000100:00100000:3.0:1788832764.468060:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 117 00000100:00100000:3.0:1788832764.468069:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:5602:x1875726975370112:12345-192.168.206.41@tcp:502: 00000100:00100000:3.0:1788832764.468780:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:5602:x1875726975370112:12345-192.168.206.41@tcp:502: Request processed in 709us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832764.468790:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 117 00000100:00100000:3.0:1788832764.495891:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832764.495988:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975370240 00000100:00100000:2.0:1788832764.495998:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975370240 00000100:00100000:2.0:1788832764.496055:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 118 00000100:00100000:2.0:1788832764.496065:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:5602:x1875726975370240:12345-192.168.206.41@tcp:502: 00000100:00100000:2.0:1788832764.496351:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:5602:x1875726975370240:12345-192.168.206.41@tcp:502: Request processed in 287us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832764.496360:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 118 00010000:00010000:3.0:1788832764.501841:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832764.502102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832764.502176:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975370368 00000100:00100000:3.0:1788832764.502186:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975370368 00000100:00100000:3.0:1788832764.502240:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 119 00000100:00100000:3.0:1788832764.502249:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:5583:x1875726975370368:12345-192.168.206.41@tcp:101: 00010000:00010000:3.0:1788832764.502266:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832764.502283:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a4aca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b552fb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832764.502338:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a4aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552fb expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832764.502350:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a4aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552fb expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832764.502359:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d027e3000, rc 0) 00000100:00100000:3.0:1788832764.502421:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:5583:x1875726975370368:12345-192.168.206.41@tcp:101: Request processed in 173us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832764.502428:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 119 00000100:00100000:3.0:1788832764.513668:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832764.513897:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975370496 00000100:00100000:0.0:1788832764.513907:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975370496 00000100:00100000:0.0:1788832764.513959:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 120 00000100:00100000:0.0:1788832764.513969:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:5583:x1875726975370496:12345-192.168.206.41@tcp:256: 20000000:01000000:0.0:1788832764.513993:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788832764.514015:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788832764.514019:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788832764.514022:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788832764.514024:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788832764.518677:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:5583:x1875726975370496:12345-192.168.206.41@tcp:256: Request processed in 4697us (5004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832764.518693:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 120 00000100:00100000:0.0:1788832764.522677:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832764.523266:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975370624 00000100:00100000:2.0:1788832764.523277:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975370624 00000100:00100000:2.0:1788832764.523334:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 121 00000100:00100000:2.0:1788832764.523343:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:5583:x1875726975370624:12345-192.168.206.41@tcp:101: 00010000:00010000:2.0:1788832764.523359:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832764.523376:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4ad1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55302 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832764.523414:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4ad1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55302 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832764.523426:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4ad1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55302 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832764.523434:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d013d1800, rc 0) 00000100:00100000:2.0:1788832764.523500:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5583:x1875726975370624:12345-192.168.206.41@tcp:101: Request processed in 157us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832764.523506:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 121 00000100:00100000:0.0:1788832764.530789:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832764.531072:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975370752 00000100:00100000:1.0:1788832764.531081:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975370752 00000100:00100000:1.0:1788832764.531123:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 122 00000100:00100000:1.0:1788832764.531131:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5583:x1875726975370752:12345-192.168.206.41@tcp:501: 00000100:00100000:1.0:1788832764.533688:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5583:x1875726975370752:12345-192.168.206.41@tcp:501: Request processed in 2548us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832764.533701:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 122 00000100:00100000:1.0:1788832764.538056:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832764.538160:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975370880 00000100:00100000:3.0:1788832764.538170:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975370880 00000100:00100000:3.0:1788832764.538218:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 123 00000100:00100000:3.0:1788832764.538226:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5583:x1875726975370880:12345-192.168.206.41@tcp:503: 00000100:00100000:3.0:1788832764.538973:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5583:x1875726975370880:12345-192.168.206.41@tcp:503: Request processed in 745us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832764.538983:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 123 00000100:00100000:0.0:1788832764.547848:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832764.548005:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975371008 00000100:00100000:3.0:1788832764.548015:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975371008 00000100:00100000:3.0:1788832764.548062:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 124 00000100:00100000:3.0:1788832764.548074:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5607:x1875726975371008:12345-192.168.206.41@tcp:502: 00000100:00100000:3.0:1788832764.548709:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5607:x1875726975371008:12345-192.168.206.41@tcp:502: Request processed in 635us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832764.548724:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 124 00000100:00100000:3.0:1788832764.555439:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832764.555474:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975371136 00000100:00100000:3.0:1788832764.555493:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975371136 00000100:00100000:3.0:1788832764.555537:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 125 00000100:00100000:3.0:1788832764.555547:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5607:x1875726975371136:12345-192.168.206.41@tcp:502: 00000100:00100000:3.0:1788832764.555797:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5607:x1875726975371136:12345-192.168.206.41@tcp:502: Request processed in 250us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832764.555805:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 125 00000100:00100000:0.0:1788832764.567026:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832764.567178:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975371264 00000100:00100000:1.0:1788832764.567188:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975371264 00000100:00100000:1.0:1788832764.567347:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 4 00000100:00100000:1.0:1788832764.567355:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1875726975371264:12345-192.168.206.41@tcp:38: 00010000:00080000:1.0:1788832764.567383:0:5854:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1788832764.567426:0:5854:0:(genops.c:1385:class_connect()) connect: client bee6676f-b533-4465-8162-bf8b5e1e90e6, cookie 0xd270a10c1c6a4ad8 00000004:00100000:1.0:1788832764.567453:0:5854:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788832764.567458:0:5854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788832764.599952:0:5854:0:(import.c:65:import_set_state_nolock()) ffff984d3bdce000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788832764.600035:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2356:x1875726975371264:12345-192.168.206.41@tcp:38: Request processed in 32678us (33015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832764.600046:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 4 00010000:00010000:1.0:1788832765.525995:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832765.590054:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832765.590078:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994267392:0@lo:13: 00000100:00100000:2.0:1788832765.590157:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832765.590343:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994267392 00000100:00100000:3.0:1788832765.590352:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994267392 00000100:00100000:3.0:1788832765.590408:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788832765.590417:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994267392:12345-0@lo:13: 00002000:00000024:3.0:1788832765.590446:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832765.590494:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994267392:12345-0@lo:13: Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832765.590501:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788832765.590595:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3989ce00 x1875726994267392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832765.590613:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994267392:0@lo:13: 00000100:00100000:0.0:1788832765.607546:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832765.607598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832765.607740:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975371392 00000100:00100000:3.0:1788832765.607771:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975371392 00000100:00100000:3.0:1788832765.607884:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975371520 00000100:00100000:3.0:1788832765.607888:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975371520 00000100:00100000:3.0:1788832765.607911:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 5 00000100:00100000:3.0:1788832765.607920:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:0:x1875726975371392:12345-192.168.206.41@tcp:41: 00000004:00000024:3.0:1788832765.607959:0:5855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788832765.608016:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:0:x1875726975371392:12345-192.168.206.41@tcp:41: Request processed in 97us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832765.608037:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 5 00000100:00100000:3.0:1788832765.608054:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:3.0:1788832765.608060:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:5583:x1875726975371520:12345-192.168.206.41@tcp:41: 00000004:00000024:3.0:1788832765.608072:0:5855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788832765.608095:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:5583:x1875726975371520:12345-192.168.206.41@tcp:41: Request processed in 35us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832765.608101:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00080000:0.0:1788832765.608346:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832765.612869:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832765.612959:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975371648 00000100:00100000:3.0:1788832765.612968:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975371648 00000100:00100000:3.0:1788832765.613024:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:3.0:1788832765.613034:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:5583:x1875726975371648:12345-192.168.206.41@tcp:40: 00000100:00100000:3.0:1788832765.613565:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:5583:x1875726975371648:12345-192.168.206.41@tcp:40: Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832765.613573:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:0.0:1788832765.615998:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832765.616055:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832765.616149:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975372160 00000100:00100000:1.0:1788832765.616158:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975372160 00000100:00100000:1.0:1788832765.616227:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 126 00000100:00100000:1.0:1788832765.616236:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2359:x1875726975372160:12345-192.168.206.41@tcp:400: 00000100:00100000:1.0:1788832765.616311:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2359:x1875726975372160:12345-192.168.206.41@tcp:400: Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832765.616318:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 126 00000100:00100000:3.0:1788832765.617018:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975372032 00000100:00100000:3.0:1788832765.617024:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975372032 00000100:00100000:3.0:1788832765.617065:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00100000:3.0:1788832765.617073:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:5583:x1875726975372032:12345-192.168.206.41@tcp:33: 00000100:00100000:0.0:1788832765.633411:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832765.633446:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832765.633544:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975371776 00000100:00100000:3.0:1788832765.633563:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975371776 00000100:00100000:3.0:1788832765.633612:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975371904 00000100:00100000:3.0:1788832765.633615:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975371904 00000100:00100000:3.0:1788832765.633628:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:3.0:1788832765.633635:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1875726975371776:12345-192.168.206.41@tcp:8: 00010000:00080000:3.0:1788832765.633662:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:3.0:1788832765.633698:0:6700:0:(genops.c:1385:class_connect()) connect: client bee6676f-b533-4465-8162-bf8b5e1e90e6, cookie 0xd270a10c1c6a4adf 00002000:00100000:3.0:1788832765.633708:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bee6676f-b533-4465-8162-bf8b5e1e90e6/ffff984d3de77800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788832765.633720:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788832765.634047:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788832765.634073:0:6700:0:(import.c:65:import_set_state_nolock()) ffff984d3de71800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832765.634826:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2356:x1875726975371776:12345-192.168.206.41@tcp:8: Request processed in 1186us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832765.634837:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:3.0:1788832765.634864:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:3.0:1788832765.634870:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1875726975371904:12345-192.168.206.41@tcp:8: 00010000:00080000:3.0:1788832765.634890:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:3.0:1788832765.634910:0:6700:0:(genops.c:1385:class_connect()) connect: client bee6676f-b533-4465-8162-bf8b5e1e90e6, cookie 0xd270a10c1c6a4ae6 00002000:00100000:3.0:1788832765.634918:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bee6676f-b533-4465-8162-bf8b5e1e90e6/ffff984d3de77000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788832765.634933:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788832765.636412:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788832765.636444:0:6700:0:(import.c:65:import_set_state_nolock()) ffff984d3de71000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832765.636491:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2356:x1875726975371904:12345-192.168.206.41@tcp:8: Request processed in 1619us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832765.636499:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 9 00000004:00080000:3.0:1788832765.647480:0:5856:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30332us 00000004:00200000:0.0:1788832765.664570:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788832765.664687:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:5583:x1875726975372032:12345-192.168.206.41@tcp:33: Request processed in 47609us (48690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832765.664702:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00100000:0.0:1788832765.953650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832765.953895:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975372288 00000100:00100000:1.0:1788832765.953905:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975372288 00000100:00100000:1.0:1788832765.953964:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:1.0:1788832765.953974:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:5624:x1875726975372288:12345-192.168.206.41@tcp:101: 00010000:00010000:1.0:1788832765.953994:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832765.954019:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04e00/0xd270a10c1c6a4aed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5532c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832765.954081:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4af4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832765.954094:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832765.954109:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832765.954141:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788832765.954145:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788832765.954161:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832765.954187:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04e00/0xd270a10c1c6a4aed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5532c expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832765.954223:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4af4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5532c expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832765.954232:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:1.0:1788832765.954234:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832765.954238:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05800, rc 0) 00000100:00100000:1.0:1788832765.954303:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:5624:x1875726975372288:12345-192.168.206.41@tcp:101: Request processed in 330us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832765.954310:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 8 00010000:00010000:1.0:1788832766.549969:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832767.573884:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788832767.695988:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bee6676f-b533-4465-8162-bf8b5e1e90e6 00000100:00100000:1.0:1788832768.151264:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832768.151357:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975372416 00000100:00100000:3.0:1788832768.151367:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975372416 00000100:00100000:3.0:1788832768.151450:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:3.0:1788832768.151462:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:5677:x1875726975372416:12345-192.168.206.41@tcp:41: 00000004:00000024:3.0:1788832768.151513:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788832768.151696:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:5677:x1875726975372416:12345-192.168.206.41@tcp:41: Request processed in 235us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832768.151704:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00080000:0.0:1788832768.152072:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832768.154399:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832768.154494:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975372544 00000100:00100000:3.0:1788832768.154504:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975372544 00000100:00100000:3.0:1788832768.154580:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:3.0:1788832768.154591:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:5677:x1875726975372544:12345-192.168.206.41@tcp:13: 00002000:00000024:3.0:1788832768.154626:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832768.154691:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:5677:x1875726975372544:12345-192.168.206.41@tcp:13: Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832768.154698:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00080000:0.0:1788832768.155310:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832768.158735:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832768.158948:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975372672 00000100:00100000:3.0:1788832768.158957:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975372672 00000100:00100000:3.0:1788832768.159019:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:3.0:1788832768.159030:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:5677:x1875726975372672:12345-192.168.206.41@tcp:13: 00002000:00000024:3.0:1788832768.159066:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832768.159145:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:5677:x1875726975372672:12345-192.168.206.41@tcp:13: Request processed in 116us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832768.159152:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00080000:0.0:1788832768.159971:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788832768.601609:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832769.174991:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994267904:0@lo:400: 00000100:00100000:1.0:1788832769.175063:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832769.175126:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788832769.175133:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994267520:0@lo:400: 00000100:00100000:1.0:1788832769.175160:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832769.175183:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994268032:0@lo:400: 00000100:00100000:1.0:1788832769.175207:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832769.175233:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994267648:0@lo:400: 00000100:00100000:1.0:1788832769.175255:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832769.175320:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994268160:0@lo:400: 00000100:00100000:1.0:1788832769.175341:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832769.175360:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832769.175366:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994267776:0@lo:400: 00000100:00100000:1.0:1788832769.175397:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832769.175433:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994267904 00000100:00100000:1.0:1788832769.175440:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994267904 00000100:00100000:1.0:1788832769.175496:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994268160 00000100:00100000:1.0:1788832769.175499:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994268160 00000100:00100000:1.0:1788832769.175517:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832769.176101:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994267904:12345-0@lo:400: 00000100:00100000:1.0:1788832769.176183:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994267904:12345-0@lo:400: Request processed in 644us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832769.176192:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832769.176218:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832769.176226:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994268160:12345-0@lo:400: 00000100:00100000:1.0:1788832769.176257:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994268160:12345-0@lo:400: Request processed in 33us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832769.176263:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832769.176294:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994268032 00000100:00100000:1.0:1788832769.176299:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994268032 00000100:00100000:1.0:1788832769.176330:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994267648 00000100:00100000:1.0:1788832769.176333:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994267648 00000100:00100000:1.0:1788832769.176344:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994267776 00000100:00100000:1.0:1788832769.176347:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994267776 00000100:00100000:1.0:1788832769.176360:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788832769.176366:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994268032:12345-0@lo:400: 00000100:00100000:1.0:1788832769.176398:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994268032:12345-0@lo:400: Request processed in 32us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832769.176405:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788832769.176416:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788832769.176422:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994267648:12345-0@lo:400: 00000100:00100000:1.0:1788832769.176464:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994267648:12345-0@lo:400: Request processed in 42us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832769.176470:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788832769.176482:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788832769.176489:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994267776:12345-0@lo:400: 00000100:00100000:1.0:1788832769.176515:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994267776:12345-0@lo:400: Request processed in 27us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832769.176521:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788832769.176692:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994268032:0@lo:400: 00010000:00080000:2.0:1788832769.176708:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d06478700 x1875726994267904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832769.176719:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994267904:0@lo:400: 00000100:00080000:1.0:1788832769.177364:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832769.177370:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832769.177372:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832769.177394:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994268288:0@lo:13: 00000100:00100000:1.0:1788832769.177441:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832769.177564:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994267520 00000100:00100000:3.0:1788832769.177570:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994267520 00000100:00100000:3.0:1788832769.177610:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788832769.177619:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994267520:12345-0@lo:400: 00000100:00100000:3.0:1788832769.177671:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994267520:12345-0@lo:400: Request processed in 52us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832769.177690:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788832769.177974:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994267776:0@lo:400: 00000100:00100000:1.0:1788832769.177988:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994267648:0@lo:400: 00010000:00080000:1.0:1788832769.178000:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b79fb80 x1875726994268160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832769.178009:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994268160:0@lo:400: 00000100:00100000:3.0:1788832769.180867:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994267520:0@lo:400: 00000100:00100000:2.0:1788832769.186825:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994268288 00000100:00100000:2.0:1788832769.186843:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994268288 00000100:00100000:2.0:1788832769.187434:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788832769.187446:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994268288:12345-0@lo:13: 00002000:00000024:2.0:1788832769.187473:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832769.187577:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994268288:12345-0@lo:13: Request processed in 134us (10135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832769.187584:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788832769.187612:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a9bc000 x1875726994268288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832769.187632:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994268288:0@lo:13: 00010000:00010000:1.0:1788832769.623024:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788832769.756855:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bee6676f-b533-4465-8162-bf8b5e1e90e6 00000001:00100000:1.0:1788832769.772582:0:5875:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bee6676f-b533-4465-8162-bf8b5e1e90e6 00010000:00010000:2.0:1788832770.651433:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832770.710442:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994268416:0@lo:13: 00000100:00100000:3.0:1788832770.710510:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832770.710697:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994268416 00000100:00100000:2.0:1788832770.710705:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994268416 00000100:00100000:2.0:1788832770.710778:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788832770.710787:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994268416:12345-0@lo:13: 00002000:00000024:2.0:1788832770.710818:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832770.710867:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994268416:12345-0@lo:13: Request processed in 81us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832770.710874:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788832770.710981:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a9be300 x1875726994268416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832770.710999:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994268416:0@lo:13: 00000100:00100000:0.0:1788832770.910803:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832770.910840:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832770.910869:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832770.910952:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975372800 00000100:00100000:2.0:1788832770.910962:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975372800 00000100:00100000:2.0:1788832770.911008:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 128 00000100:00100000:2.0:1788832770.911018:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2358:x1875726975372800:12345-192.168.206.41@tcp:400: 00000100:00100000:2.0:1788832770.911096:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2358:x1875726975372800:12345-192.168.206.41@tcp:400: Request processed in 79us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832770.911104:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 128 00000100:00100000:3.0:1788832770.911330:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975373056 00000100:00100000:3.0:1788832770.911335:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975373056 00000100:00080000:2.0:1788832770.914336:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832770.914596:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832770.914696:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975372928 00000100:00100000:1.0:1788832770.914705:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975372928 00000100:00100000:1.0:1788832770.914877:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 22 00000100:00100000:1.0:1788832770.914887:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975372928:12345-192.168.206.41@tcp:400: 00000100:00100000:1.0:1788832770.914955:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975372928:12345-192.168.206.41@tcp:400: Request processed in 69us (4084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832770.914968:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 22 00000100:00080000:2.0:1788832770.915006:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832770.919234:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975373184 00000100:00100000:3.0:1788832770.919247:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975373184 00000100:00100000:3.0:1788832770.919324:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:3.0:1788832770.919335:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975373056:12345-192.168.206.41@tcp:400: 00000100:00100000:3.0:1788832770.919409:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975373056:12345-192.168.206.41@tcp:400: Request processed in 76us (8568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832770.919416:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:3.0:1788832770.919432:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:3.0:1788832770.919439:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975373184:12345-192.168.206.41@tcp:400: 00000100:00100000:3.0:1788832770.919463:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975373184:12345-192.168.206.41@tcp:400: Request processed in 25us (4873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832770.919469:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00080000:0.0:1788832770.921301:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1788832771.000254:0:8303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788832771.670449:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832772.697999:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832773.718345:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832774.296385:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994268672:0@lo:400: 00000100:00100000:2.0:1788832774.296449:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832774.296509:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994269184:0@lo:400: 00000100:00100000:2.0:1788832774.296535:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832774.296549:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994268544:0@lo:400: 00000100:00100000:2.0:1788832774.296564:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832774.296570:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994268800:0@lo:400: 00000100:00100000:3.0:1788832774.296583:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832774.296587:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832774.296604:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994269056:0@lo:400: 00000100:00100000:2.0:1788832774.296618:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994268672 00000100:00100000:2.0:1788832774.296624:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994268672 00000100:00100000:3.0:1788832774.296633:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832774.296648:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788832774.296654:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994268928:0@lo:400: 00000100:00100000:2.0:1788832774.296660:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994268800 00000100:00100000:2.0:1788832774.296663:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994268800 00000100:00100000:3.0:1788832774.296673:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832774.296684:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994269056 00000100:00100000:2.0:1788832774.296687:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994269056 00000100:00100000:2.0:1788832774.296702:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788832774.296709:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994268672:12345-0@lo:400: 00000100:00100000:2.0:1788832774.296789:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994268672:12345-0@lo:400: Request processed in 79us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.296797:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788832774.296813:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832774.296820:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994268800:12345-0@lo:400: 00000100:00100000:2.0:1788832774.296859:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994268800:12345-0@lo:400: Request processed in 39us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.296865:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832774.296879:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788832774.296885:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994269056:12345-0@lo:400: 00000100:00100000:2.0:1788832774.296924:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994269056:12345-0@lo:400: Request processed in 39us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.296931:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788832774.296973:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994269184 00000100:00100000:2.0:1788832774.296977:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994269184 00000100:00100000:2.0:1788832774.297000:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994268928 00000100:00100000:2.0:1788832774.297003:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994268928 00000100:00100000:2.0:1788832774.297018:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788832774.297025:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994269184:12345-0@lo:400: 00000100:00100000:2.0:1788832774.297055:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994269184:12345-0@lo:400: Request processed in 31us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.297061:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788832774.297072:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788832774.297078:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994268928:12345-0@lo:400: 00000100:00100000:2.0:1788832774.297103:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994268928:12345-0@lo:400: Request processed in 25us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.297109:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788832774.297129:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832774.297133:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832774.297135:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832774.297147:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994269312:0@lo:13: 00000100:00100000:2.0:1788832774.297173:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832774.297209:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994269312 00000100:00100000:2.0:1788832774.297213:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994269312 00000100:00100000:2.0:1788832774.297236:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788832774.297255:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994269312:12345-0@lo:13: 00002000:00000024:2.0:1788832774.297282:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832774.297316:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994269312:12345-0@lo:13: Request processed in 73us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.297322:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788832774.297356:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a9bed80 x1875726994269312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832774.297372:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994269312:0@lo:13: 00000100:00100000:2.0:1788832774.297401:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994268800:0@lo:400: 00000100:00100000:2.0:1788832774.297410:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994268672:0@lo:400: 00010000:00080000:2.0:1788832774.297418:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a9bd500 x1875726994269184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832774.297426:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994269184:0@lo:400: 00010000:00080000:3.0:1788832774.297906:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a9bdf80 x1875726994268928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832774.297918:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994268928:0@lo:400: 00000100:00100000:3.0:1788832774.297928:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994269056:0@lo:400: 00000100:00100000:1.0:1788832774.300161:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994268544 00000100:00100000:1.0:1788832774.300174:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994268544 00000100:00100000:1.0:1788832774.300240:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788832774.300260:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994268544:12345-0@lo:400: 00000100:00100000:1.0:1788832774.300356:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994268544:12345-0@lo:400: Request processed in 97us (3770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832774.300363:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788832774.300556:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994268544:0@lo:400: 00000020:00000080:3.0:1788832774.392575:0:8450:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2753ee30 20000000:00000080:3.0:1788832774.392592:0:8450:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984d3a146c00 uarg=0000000000000000 20000000:01000000:3.0:1788832774.392625:0:8450:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788832774.392627:0:8450:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788832774.392630:0:8450:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788832774.392634:0:8450:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788832774.392639:0:8450:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788832774.392651:0:8450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788832774.392654:0:8450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788832774.392843:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788832774.392846:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788832774.394292:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788832774.394729:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788832774.395173:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788832774.395232:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788832774.395257:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788832774.395260:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788832774.396124:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788832774.396508:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788832774.396555:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788832774.396599:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788832774.396611:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788832774.396614:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788832774.397550:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788832774.399442:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788832774.399523:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788832774.399561:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788832774.399577:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788832774.399579:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788832774.401137:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788832774.401780:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788832774.401891:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788832774.401943:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1788832774.401961:0:8450:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788832774.401979:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402016:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d027e3e00/0xd270a10c1c6a49f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a49f1 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402025:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a1b expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402031:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a45 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402037:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a4a5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a53 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402043:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d027e3600/0xd270a10c1c6a4a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a61 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402049:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a4a84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a7d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402055:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4aa7 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402065:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d05f05c00/0xd270a10c1c6a4abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552ca expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402072:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a4ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552d1 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402078:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402123:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a4ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552d1 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402138:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a4ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552d1 expref: 9 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.402152:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994269440:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832774.402262:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d05f05c00/0xd270a10c1c6a4abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552ca expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402271:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d05f05c00/0xd270a10c1c6a4abc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552ca expref: 9 pid: 5848 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.402279:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994269568:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832774.402310:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4aa7 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402317:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4aae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4aa7 expref: 18 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.402326:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994269696:0@lo:104: 00000100:00100000:2.0:1788832774.402362:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832774.402395:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a4a84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4a7d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402403:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a4a84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a7d expref: 18 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.402422:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994269824:0@lo:104: 00000100:00100000:2.0:1788832774.402448:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832774.402484:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788832774.402496:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994269696 00000100:00100000:2.0:1788832774.402502:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994269696 00000100:00100000:2.0:1788832774.402537:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994269824 00000100:00100000:2.0:1788832774.402540:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994269824 00000100:00100000:2.0:1788832774.402555:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788832774.402563:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+4:8450:x1875726994269696:12345-0@lo:104: 00010000:00010000:2.0:1788832774.402574:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4aae expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402620:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832774.402626:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+4:8450:x1875726994269696:12345-0@lo:104: Request processed in 63us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.402632:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788832774.402647:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788832774.402653:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:8450:x1875726994269824:12345-0@lo:104: 00010000:00010000:2.0:1788832774.402660:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4a84 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402691:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788832774.402696:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:8450:x1875726994269824:12345-0@lo:104: Request processed in 44us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.402701:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788832774.402733:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832774.402739:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4aae expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402772:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04600 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788832774.402776:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4aae expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402784:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4aae expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832774.402791:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4aae expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832774.402796:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832774.402820:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4aae expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402826:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832774.402845:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4aae expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402852:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d05f04600/0xd270a10c1c6a4aa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4aae expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402864:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832774.402867:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4a84 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402872:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05e00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788832774.402874:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4a84 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402890:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4a84 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832774.402896:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4a84 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832774.402902:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832774.402916:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a84 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402921:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832774.402926:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a84 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402931:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d05f05e00/0xd270a10c1c6a4a7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a84 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.402939:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832774.402940:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832774.402942:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832774.402948:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832774.402958:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994269952:0@lo:103: 00000100:00100000:2.0:1788832774.402985:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832774.403006:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832774.403012:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994270080:0@lo:103: 00000100:00100000:2.0:1788832774.403032:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832774.403059:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994269952 00000100:00100000:2.0:1788832774.403062:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994269952 00010000:00010000:2.0:1788832774.403079:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4aae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4aa7 expref: 19 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.403105:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994270080 00000100:00100000:2.0:1788832774.403108:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994270080 00010000:00010000:2.0:1788832774.403120:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a4a84 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a7d expref: 20 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.403141:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788832774.403147:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+20:3314:x1875726994269952:12345-0@lo:103: 00010000:00010000:2.0:1788832774.403156:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832774.403161:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4aae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4aa7 expref: 20 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403169:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4aae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4aa7 expref: 20 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403181:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832774.403208:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+20:3314:x1875726994269952:12345-0@lo:103: Request processed in 60us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.403214:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788832774.403226:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788832774.403232:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994270080:12345-0@lo:103: 00010000:00010000:2.0:1788832774.403239:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832774.403255:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a4a84 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a7d expref: 19 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403263:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a4a84 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a7d expref: 19 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403273:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832774.403303:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994270080:12345-0@lo:103: Request processed in 70us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.403309:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788832774.403340:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994270080:0@lo:103: 00000100:00100000:2.0:1788832774.403348:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994269952:0@lo:103: 00010000:00010000:2.0:1788832774.403378:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d027e3600/0xd270a10c1c6a4a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4a61 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403386:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d027e3600/0xd270a10c1c6a4a68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a61 expref: 18 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.403395:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994270208:0@lo:104: 00000100:00100000:2.0:1788832774.403417:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832774.403437:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994270208 00000100:00100000:2.0:1788832774.403440:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994270208 00000100:00100000:2.0:1788832774.403457:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788832774.403462:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:8450:x1875726994270208:12345-0@lo:104: 00010000:00010000:2.0:1788832774.403470:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4a68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403501:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832774.403506:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:8450:x1875726994270208:12345-0@lo:104: Request processed in 45us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.403512:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788832774.403526:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832774.403530:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4a68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403546:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05000 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788832774.403549:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4a68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403555:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4a68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832774.403560:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4a68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832774.403564:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832774.403578:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403583:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832774.403595:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403601:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4a61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403609:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832774.403611:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832774.403613:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832774.403621:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994270336:0@lo:103: 00000100:00100000:2.0:1788832774.403644:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832774.403670:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994270336 00000100:00100000:2.0:1788832774.403673:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994270336 00010000:00010000:2.0:1788832774.403686:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d027e3600/0xd270a10c1c6a4a68 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a61 expref: 19 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.403712:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788832774.403718:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994270336:12345-0@lo:103: 00010000:00010000:2.0:1788832774.403725:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832774.403729:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d027e3600/0xd270a10c1c6a4a68 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a61 expref: 19 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403737:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d027e3600/0xd270a10c1c6a4a68 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a61 expref: 19 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403766:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832774.403794:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994270336:12345-0@lo:103: Request processed in 76us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.403800:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788832774.403824:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994270336:0@lo:103: 00010000:00010000:2.0:1788832774.403850:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a4a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4a53 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403859:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a4a5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a53 expref: 18 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.403867:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994270464:0@lo:104: 00000100:00100000:2.0:1788832774.403889:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832774.403907:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994270464 00000100:00100000:2.0:1788832774.403910:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994270464 00000100:00100000:2.0:1788832774.403925:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788832774.403931:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06478a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:8450:x1875726994270464:12345-0@lo:104: 00010000:00010000:2.0:1788832774.403938:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4a5a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.403974:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832774.403979:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06478a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:8450:x1875726994270464:12345-0@lo:104: Request processed in 49us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.403985:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1788832774.404000:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832774.404004:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4a5a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.404010:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04a00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788832774.404013:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4a5a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.404020:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4a5a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832774.404027:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4a5a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832774.404031:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832774.404046:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a5a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.404051:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832774.404062:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a5a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.404069:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d05f04a00/0xd270a10c1c6a4a53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a5a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.404087:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832774.404089:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832774.404091:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832774.404100:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994270592:0@lo:103: 00000100:00100000:2.0:1788832774.404123:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832774.404148:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994270592 00000100:00100000:2.0:1788832774.404152:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994270592 00010000:00010000:2.0:1788832774.404166:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a4a5a lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a53 expref: 19 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.404183:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788832774.404189:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994270592:12345-0@lo:103: 00010000:00010000:2.0:1788832774.404196:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832774.404200:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a4a5a lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a53 expref: 19 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.404208:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a4a5a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a53 expref: 19 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.404218:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832774.404256:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994270592:12345-0@lo:103: Request processed in 67us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.404828:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1788832774.405225:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4a45 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832774.405237:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a45 expref: 18 pid: 5848 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832774.405259:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a571880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994270720:0@lo:104: 00000100:00100000:3.0:1788832774.405292:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832774.405330:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4a1b expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832774.405338:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4a22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a1b expref: 18 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832774.405345:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a572300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994270848:0@lo:104: 00000100:00100000:3.0:1788832774.405365:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832774.405389:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994270720 00000100:00100000:3.0:1788832774.405394:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994270720 00000100:00100000:3.0:1788832774.405417:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994270848 00000100:00100000:3.0:1788832774.405419:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994270848 00000100:00100000:3.0:1788832774.405431:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788832774.405438:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+4:8450:x1875726994270720:12345-0@lo:104: 00010000:00010000:3.0:1788832774.405447:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4a4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832774.405484:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788832774.405489:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+4:8450:x1875726994270720:12345-0@lo:104: Request processed in 53us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832774.405495:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788832774.405509:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788832774.405523:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a571c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:8450:x1875726994270848:12345-0@lo:104: 00010000:00010000:3.0:1788832774.405530:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4a22 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832774.405562:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788832774.405567:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a571c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:8450:x1875726994270848:12345-0@lo:104: Request processed in 45us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832774.405573:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1788832774.405599:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d027e3e00/0xd270a10c1c6a49f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a49f1 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832774.405608:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d027e3e00/0xd270a10c1c6a49f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a49f1 expref: 18 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832774.405616:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a570e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994270976:0@lo:104: 00000100:00100000:3.0:1788832774.405638:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832774.405657:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994270976 00000100:00100000:3.0:1788832774.405660:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994270976 00000100:00100000:3.0:1788832774.405675:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788832774.405680:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:8450:x1875726994270976:12345-0@lo:104: 00010000:00010000:3.0:1788832774.405686:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a49f8 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832774.405714:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788832774.405719:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:8450:x1875726994270976:12345-0@lo:104: Request processed in 39us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832774.405725:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788832774.405765:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d11418e40 going to sleep for 11 seconds 00010000:00010000:3.0:1788832774.405786:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e2e00/0xd270a10c1c6a4aae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4aa7 expref: 18 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832774.405803:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994269696:0@lo:104: 00010000:00010000:3.0:1788832774.405816:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e3c00/0xd270a10c1c6a4a84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4a7d expref: 17 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832774.405824:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994269824:0@lo:104: 00010000:00010000:3.0:1788832774.405834:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e3600/0xd270a10c1c6a4a68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4a61 expref: 16 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832774.406336:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994270208:0@lo:104: 00010000:00010000:3.0:1788832774.406351:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e2600/0xd270a10c1c6a4a5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4a53 expref: 15 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832774.406359:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994270464:0@lo:104: 00000100:00100000:3.0:1788832774.406366:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a571880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994270720:0@lo:104: 00000100:00100000:3.0:1788832774.406372:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a572300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994270848:0@lo:104: 00000100:00100000:3.0:1788832774.406378:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a570e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994270976:0@lo:104: 00010000:00010000:0.0:1788832774.406524:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788832774.406531:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4a4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406539:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05a00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788832774.406543:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4a4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406559:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4a4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832774.406566:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4a4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832774.406571:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832774.406606:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406611:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832774.406636:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406643:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d05f05a00/0xd270a10c1c6a4a45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a4c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406654:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788832774.406657:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4a22 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406663:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d027e3200 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788832774.406665:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4a22 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406672:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4a22 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832774.406678:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4a22 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832774.406690:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832774.406704:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a22 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406710:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832774.406715:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a22 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406722:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d027e3200/0xd270a10c1c6a4a1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a22 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406731:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832774.406734:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a49f8 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406739:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d00030c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788832774.406763:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a49f8 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406771:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a49f8 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832774.406777:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a49f8 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832774.406782:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832774.406811:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a49f8 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406817:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832774.406833:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a49f8 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406839:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a49f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a49f8 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.406854:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832774.406856:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832774.406858:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832774.407121:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994271104:0@lo:103: 00000100:00100000:3.0:1788832774.407159:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832774.407231:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994271232:0@lo:103: 00000100:00100000:0.0:1788832774.407270:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832774.407334:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832774.407346:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994271360:0@lo:103: 00010000:00010000:2.0:1788832774.407375:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832774.407456:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994270592:0@lo:103: 00000100:00100000:2.0:1788832774.407527:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832774.407691:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994271104 00000100:00100000:3.0:1788832774.407697:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994271104 00010000:00010000:2.0:1788832774.407796:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a45 expref: 15 pid: 5848 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.407820:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994271232 00000100:00100000:2.0:1788832774.407824:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994271232 00010000:00010000:2.0:1788832774.407835:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4a22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a1b expref: 16 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.407845:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994271360 00000100:00100000:2.0:1788832774.407847:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994271360 00010000:00010000:2.0:1788832774.407856:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d027e3e00/0xd270a10c1c6a49f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a49f1 expref: 17 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.407879:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788832774.407887:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a571f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+17:3314:x1875726994271104:12345-0@lo:103: 00010000:00010000:2.0:1788832774.407899:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832774.407904:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a45 expref: 17 pid: 5848 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.407914:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a45 expref: 17 pid: 5848 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.407928:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d1e00/0xd270a10c1c6a4a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4a45 expref: 17 pid: 5848 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.407956:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832774.407991:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a571f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+16:3314:x1875726994271104:12345-0@lo:103: Request processed in 105us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.407997:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788832774.408022:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788832774.408029:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b366a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+15:3315:x1875726994271232:12345-0@lo:103: 00010000:00010000:2.0:1788832774.408043:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832774.408048:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4a22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a1b expref: 15 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.408057:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a1b expref: 15 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.408066:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4a22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4a1b expref: 15 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.408075:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832774.408103:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b366a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+14:3315:x1875726994271232:12345-0@lo:103: Request processed in 76us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.408110:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788832774.408123:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788832774.408130:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d08a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+13:3316:x1875726994271360:12345-0@lo:103: 00010000:00010000:2.0:1788832774.408137:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832774.408142:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d027e3e00/0xd270a10c1c6a49f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a49f1 expref: 13 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.408150:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d027e3e00/0xd270a10c1c6a49f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a49f1 expref: 13 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.408160:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e3e00/0xd270a10c1c6a49f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a49f1 expref: 13 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.408169:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832774.408196:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d08a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32c45e-9a6a-4349-b87e-107522b34816+12:3316:x1875726994271360:12345-0@lo:103: Request processed in 67us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832774.408202:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788832774.408271:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994271232:0@lo:103: 00000100:00100000:2.0:1788832774.408293:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994271360:0@lo:103: 00000100:00100000:2.0:1788832774.408315:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994271104:0@lo:103: 00000100:00100000:1.0:1788832774.409848:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832774.409894:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832774.409965:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975373312 00000100:00100000:0.0:1788832774.409972:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975373312 00010000:00010000:0.0:1788832774.409999:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a4ac3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552d1 expref: 10 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832774.410038:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975373440 00000100:00100000:0.0:1788832774.410042:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975373440 00010000:00010000:0.0:1788832774.410054:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d05f05c00/0xd270a10c1c6a4abc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552ca expref: 11 pid: 5848 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832774.410075:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 19 00000100:00100000:0.0:1788832774.410082:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:2358:x1875726975373312:12345-192.168.206.41@tcp:103: 00010000:00010000:0.0:1788832774.410093:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832774.410097:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a4ac3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552d1 expref: 11 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.410107:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a4ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552d1 expref: 11 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.410131:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832774.410172:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:2358:x1875726975373312:12345-192.168.206.41@tcp:103: Request processed in 89us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832774.410179:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 19 00000100:00100000:0.0:1788832774.410195:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 20 00000100:00100000:0.0:1788832774.410202:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2357:x1875726975373440:12345-192.168.206.41@tcp:103: 00010000:00010000:0.0:1788832774.410211:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832774.410216:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d05f05c00/0xd270a10c1c6a4abc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552ca expref: 10 pid: 5848 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.410224:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d05f05c00/0xd270a10c1c6a4abc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552ca expref: 10 pid: 5848 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.410236:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.410259:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.410274:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.410281:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.410288:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.410294:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.410307:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d013d0800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:0.0:1788832774.410311:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.410320:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.410329:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.410339:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832774.410359:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2357:x1875726975373440:12345-192.168.206.41@tcp:103: Request processed in 157us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832774.410366:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 20 00010000:00010000:3.0:1788832774.411103:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d0600/0xd270a10c1c6a4ac3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552d1 expref: 9 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832774.411117:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994269440:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832774.411203:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d05f05c00/0xd270a10c1c6a4abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552ca expref: 8 pid: 5848 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832774.411213:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875726994269568:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832774.411261:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.411270:0:8450:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.411276:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832774.411282:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d0800/0xd270a10c1c6a4afb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832774.746673:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832775.769127:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832775.829976:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832775.830000:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994271488:0@lo:13: 00000100:00100000:2.0:1788832775.830064:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.830139:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994271488 00000100:00100000:2.0:1788832775.830147:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994271488 00000100:00100000:2.0:1788832775.830189:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788832775.830199:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994271488:12345-0@lo:13: 00002000:00000024:2.0:1788832775.830228:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832775.830311:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994271488:12345-0@lo:13: Request processed in 113us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832775.830318:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788832775.830428:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d0647a300 x1875726994271488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832775.830449:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994271488:0@lo:13: 10000000:01000000:3.0:1788832775.830608:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788832775.830618:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984d07487000 from 39 10000000:01000000:3.0:1788832775.830622:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788832775.830652:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832775.830662:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832775.830673:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832775.830689:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994271616:0@lo:101: 00000100:00100000:3.0:1788832775.830916:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832775.830937:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994271616 00000100:00100000:3.0:1788832775.830942:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c0627a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788832775.830942:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994271616 00000100:00100000:1.0:1788832775.830981:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788832775.830989:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+12:5850:x1875726994271616:12345-0@lo:101: 00010000:00010000:1.0:1788832775.830999:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832775.831027:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d05f04e00/0xd270a10c1c6a4b09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4b02 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832775.831047:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d05f04e00/0xd270a10c1c6a4b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b02 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832775.831058:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d05f04e00/0xd270a10c1c6a4b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b02 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832775.831079:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04e00, rc 0) 00000100:00100000:1.0:1788832775.831112:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:5850:x1875726994271616:12345-0@lo:101: Request processed in 124us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832775.831119:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788832775.831141:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994271616:0@lo:101: 00010000:00010000:3.0:1788832775.831154:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832775.831310:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832775.831368:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994271744:0@lo:501: 00000100:00100000:3.0:1788832775.831394:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832775.831414:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c0627a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788832775.831498:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994271744 00000100:00100000:1.0:1788832775.831502:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994271744 00000100:00100000:1.0:1788832775.831534:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788832775.831541:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:5850:x1875726994271744:12345-0@lo:501: 00000100:00100000:1.0:1788832775.831892:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:5850:x1875726994271744:12345-0@lo:501: Request processed in 350us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832775.831900:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788832775.833853:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994271744:0@lo:501: 00000100:00100000:2.0:1788832775.833905:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994271872:0@lo:503: 00000100:00100000:2.0:1788832775.833967:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.834026:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b02e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832775.834209:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994271872 00000100:00100000:0.0:1788832775.834216:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994271872 00000100:00100000:0.0:1788832775.834268:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788832775.834278:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:5850:x1875726994271872:12345-0@lo:503: 00000100:00100000:0.0:1788832775.834720:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:5850:x1875726994271872:12345-0@lo:503: Request processed in 442us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832775.834727:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788832775.834965:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994271872:0@lo:503: 00000100:00100000:2.0:1788832775.835591:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8469:1875726994272000:0@lo:502: 00000100:00100000:2.0:1788832775.835637:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.835674:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b020c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832775.835784:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994272000 00000100:00100000:1.0:1788832775.835790:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994272000 00000100:00100000:1.0:1788832775.835828:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788832775.835836:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:8469:x1875726994272000:12345-0@lo:502: 00000100:00100000:1.0:1788832775.836029:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+13:8469:x1875726994272000:12345-0@lo:502: Request processed in 193us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832775.836036:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788832775.836336:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8469:1875726994272000:0@lo:502: 00000100:00100000:2.0:1788832775.836531:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8469:1875726994272128:0@lo:502: 00000100:00100000:2.0:1788832775.836653:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.836715:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832775.843943:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994272128 00000100:00100000:0.0:1788832775.843958:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994272128 00000100:00100000:0.0:1788832775.844035:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788832775.844045:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:8469:x1875726994272128:12345-0@lo:502: 00000100:00100000:0.0:1788832775.845045:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+13:8469:x1875726994272128:12345-0@lo:502: Request processed in 997us (8473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832775.845055:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788832775.846641:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8469:1875726994272128:0@lo:502: 00000040:00080000:3.0:1788832775.846688:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788832775.848203:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788832775.848229:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788832775.848252:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.848264:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832775.848274:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788832775.848277:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788832775.848280:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788832775.848331:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.848339:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.848349:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832775.848370:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994272256:0@lo:101: 00000100:00100000:2.0:1788832775.848430:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.848472:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832775.849228:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994272256 00000100:00100000:3.0:1788832775.849245:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994272256 00000100:00100000:3.0:1788832775.849293:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788832775.849312:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+13:5850:x1875726994272256:12345-0@lo:101: 00010000:00010000:3.0:1788832775.849326:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832775.849339:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3ada3a00/0xd270a10c1c6a4b17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4b10 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832775.849362:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3ada3a00/0xd270a10c1c6a4b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b10 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832775.849373:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3ada3a00/0xd270a10c1c6a4b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b10 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832775.849381:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3a00, rc 0) 00000100:00100000:3.0:1788832775.849442:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994272256:12345-0@lo:101: Request processed in 132us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832775.849449:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788832775.849478:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994272256:0@lo:101: 00010000:00010000:2.0:1788832775.849494:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.849503:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832775.849550:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994272384:0@lo:501: 00000100:00100000:2.0:1788832775.849577:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.849597:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832775.849687:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994272384 00000100:00100000:0.0:1788832775.849693:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994272384 00000100:00100000:0.0:1788832775.849722:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788832775.849730:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994272384:12345-0@lo:501: 00000100:00100000:0.0:1788832775.850000:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994272384:12345-0@lo:501: Request processed in 271us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832775.850007:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788832775.850278:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994272384:0@lo:501: 00000100:00100000:2.0:1788832775.850313:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994272512:0@lo:503: 00000100:00100000:2.0:1788832775.850351:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.850381:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832775.850415:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994272512 00000100:00100000:3.0:1788832775.850421:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994272512 00000100:00100000:3.0:1788832775.850453:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788832775.850460:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994272512:12345-0@lo:503: 00000100:00100000:3.0:1788832775.850617:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994272512:12345-0@lo:503: Request processed in 158us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832775.850623:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788832775.850727:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994272512:0@lo:503: 00000100:00100000:3.0:1788832775.851394:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8470:1875726994272640:0@lo:502: 00000100:00100000:3.0:1788832775.851436:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832775.851474:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c0627a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788832775.851497:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994272640 00000100:00100000:1.0:1788832775.851503:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994272640 00000100:00100000:1.0:1788832775.851538:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788832775.851545:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:8470:x1875726994272640:12345-0@lo:502: 00000100:00100000:1.0:1788832775.851814:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+14:8470:x1875726994272640:12345-0@lo:502: Request processed in 268us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832775.851821:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788832775.852005:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8470:1875726994272640:0@lo:502: 00000020:01000000:3.0:1788832775.852032:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832775.852045:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832775.852047:0:8470:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788832775.852054:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788832775.852073:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8470:1875726994272768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832775.852103:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832775.852133:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832775.852203:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994272768 00000100:00100000:1.0:1788832775.852208:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994272768 00000100:00100000:1.0:1788832775.852279:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788832775.852286:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+14:8470:x1875726994272768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832775.852439:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+14:8470:x1875726994272768:12345-0@lo:502:llog_process_th.0 Request processed in 153us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832775.852446:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788832775.852505:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8470:1875726994272768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788832775.852522:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832775.852526:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832775.852528:0:8470:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788832775.852531:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788832775.852678:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788832775.852701:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788832775.852711:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.852721:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832775.852729:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788832775.852768:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984d39f1a000 from 39 10000000:01000000:2.0:1788832775.852771:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788832775.852795:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.852802:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.852811:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832775.852824:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994272896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832775.852851:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832775.854317:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994272896 00000100:00100000:0.0:1788832775.854328:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994272896 00000100:00100000:0.0:1788832775.854372:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788832775.854380:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+14:5850:x1875726994272896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832775.854393:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832775.854408:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d00031000/0xd270a10c1c6a4b25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4b1e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832775.854926:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d00031000/0xd270a10c1c6a4b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b1e expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832775.854939:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d00031000/0xd270a10c1c6a4b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b1e expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832775.854947:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d00031000, rc 0) 00000100:00100000:0.0:1788832775.854995:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994272896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 616us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832775.855119:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788832775.855389:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b02c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832775.855419:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994272896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832775.855617:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832775.855629:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832775.855688:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994273024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832775.855715:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832775.855793:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d08bc7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788832775.855834:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994273024 00000100:00100000:3.0:1788832775.855839:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994273024 00000100:00100000:1.0:1788832775.855880:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788832775.855888:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994273024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832775.856118:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994273024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832775.856132:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788832775.856691:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994273024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832775.856721:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994273152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832775.856781:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832775.856801:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d08bc7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788832775.857116:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994273152 00000100:00100000:1.0:1788832775.857129:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994273152 00000100:00100000:1.0:1788832775.857166:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788832775.857172:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994273152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832775.857340:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994273152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832775.857356:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788832775.857395:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994273152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832775.857893:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8471:1875726994273280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832775.857930:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832775.857966:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d11418480 going to sleep for 11 seconds 00000100:00100000:3.0:1788832775.858194:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994273280 00000100:00100000:3.0:1788832775.858200:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994273280 00000100:00100000:0.0:1788832775.858657:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788832775.858668:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+15:8471:x1875726994273280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832775.858954:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+15:8471:x1875726994273280:12345-0@lo:502:llog_process_th.0 Request processed in 288us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832775.858962:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788832775.859921:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8471:1875726994273280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832775.859981:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8471:1875726994273408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832775.860055:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.860096:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b02000 going to sleep for 11 seconds 00000100:00100000:1.0:1788832775.860317:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994273408 00000100:00100000:1.0:1788832775.860323:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994273408 00000100:00100000:1.0:1788832775.860370:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788832775.860378:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+15:8471:x1875726994273408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832775.860779:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+15:8471:x1875726994273408:12345-0@lo:502:llog_process_th.0 Request processed in 401us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832775.860787:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788832775.860946:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8471:1875726994273408:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788832775.860976:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788832775.861305:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788832775.861319:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788832775.861329:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832775.861339:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832775.861358:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788832775.861361:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788832775.861363:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788832775.861389:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832775.861396:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832775.861405:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832775.861579:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994273536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788832775.861616:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832775.861657:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d2da35240 going to sleep for 11 seconds 00000100:00100000:2.0:1788832775.861782:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994273536 00000100:00100000:2.0:1788832775.861787:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994273536 00000100:00100000:2.0:1788832775.861828:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788832775.861835:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+15:5850:x1875726994273536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832775.861845:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832775.861858:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d013d1000/0xd270a10c1c6a4b33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4b2c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.861879:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d1000/0xd270a10c1c6a4b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b2c expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.861889:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d013d1000/0xd270a10c1c6a4b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b2c expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.861897:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d013d1000, rc 0) 00000100:00100000:2.0:1788832775.861931:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994273536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832775.861937:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788832775.862246:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994273536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832775.862259:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832775.862267:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832775.862326:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994273664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832775.862362:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832775.862388:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d2da35240 going to sleep for 11 seconds 00000100:00100000:1.0:1788832775.862403:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994273664 00000100:00100000:1.0:1788832775.862653:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994273664 00000100:00100000:1.0:1788832775.862691:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788832775.862698:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994273664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832775.863205:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994273664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 506us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832775.863212:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788832775.863305:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994273664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832775.863347:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994273792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832775.863929:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.863968:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b02540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832775.864673:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994273792 00000100:00100000:0.0:1788832775.864682:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994273792 00000100:00100000:0.0:1788832775.864738:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788832775.864775:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994273792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832775.864962:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994273792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832775.864969:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788832775.865649:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994273792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832775.867982:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b366d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8472:1875726994273920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832775.868229:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832775.868374:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d11418f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832775.868561:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994273920 00000100:00100000:1.0:1788832775.868629:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994273920 00000100:00100000:1.0:1788832775.868706:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788832775.868715:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+16:8472:x1875726994273920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832775.868951:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+16:8472:x1875726994273920:12345-0@lo:502:llog_process_th.0 Request processed in 237us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832775.868959:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788832775.869060:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b366d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8472:1875726994273920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832775.869090:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832775.869103:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832775.869106:0:8472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788832775.869111:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788832775.869148:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8472:1875726994274048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832775.869182:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.869961:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b02540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832775.870080:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994274048 00000100:00100000:0.0:1788832775.870086:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994274048 00000100:00100000:0.0:1788832775.870114:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788832775.870218:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+16:8472:x1875726994274048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832775.870400:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+16:8472:x1875726994274048:12345-0@lo:502:llog_process_th.0 Request processed in 279us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832775.870413:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788832775.870544:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8472:1875726994274048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832775.870577:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832775.870583:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832775.870585:0:8472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788832775.870588:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788832775.870637:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788832775.870653:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788832775.870662:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.870672:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832775.870681:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788832775.870684:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984d2a26c800 from 39 10000000:01000000:2.0:1788832775.870686:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788832775.870708:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.870716:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.870725:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832775.870767:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994274176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832775.870794:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.870802:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b02540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832775.870952:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994274176 00000100:00100000:0.0:1788832775.870956:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994274176 00000100:00100000:0.0:1788832775.870972:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788832775.870977:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994274176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832775.870985:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832775.870994:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4b41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4b3a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832775.871119:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b3a expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832775.871196:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b3a expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832775.871204:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d00031800, rc 0) 00000100:00100000:0.0:1788832775.871249:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994274176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 272us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832775.871255:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788832775.871560:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994274176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832775.871626:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.871635:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832775.871675:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994274304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832775.871699:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.871718:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b02540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832775.871768:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994274304 00000100:00100000:0.0:1788832775.871772:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994274304 00000100:00100000:0.0:1788832775.871797:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788832775.871803:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994274304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832775.871985:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994274304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832775.871991:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788832775.872249:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994274304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832775.872275:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994274432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832775.872312:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.872338:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b02540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832775.872384:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994274432 00000100:00100000:0.0:1788832775.872388:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994274432 00000100:00100000:0.0:1788832775.872637:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788832775.872649:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994274432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832775.872892:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994274432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832775.872899:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788832775.873269:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994274432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832775.874870:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8473:1875726994274560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832775.874936:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832775.875005:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832775.875217:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994274560 00000100:00100000:2.0:1788832775.875224:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994274560 00000100:00100000:2.0:1788832775.875313:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788832775.875321:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:8473:x1875726994274560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832775.875716:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8473:1875726994274560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832775.875800:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8473:1875726994274688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832775.875833:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.875863:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:8473:x1875726994274560:12345-0@lo:502:llog_process_th.0 Request processed in 242us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832775.875880:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788832775.876328:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832775.876439:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994274688 00000100:00100000:2.0:1788832775.876445:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994274688 00000100:00100000:2.0:1788832775.876465:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788832775.876472:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:8473:x1875726994274688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832775.876847:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:8473:x1875726994274688:12345-0@lo:502:llog_process_th.0 Request processed in 375us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832775.876854:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788832775.876934:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8473:1875726994274688:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788832775.876957:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788832775.877574:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788832775.877591:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788832775.877601:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.877612:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832775.877621:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788832775.877624:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788832775.877627:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788832775.877653:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.877661:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.877671:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832775.877689:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994274816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832775.877734:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.877825:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832775.877910:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994274816 00000100:00100000:0.0:1788832775.877915:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994274816 00000100:00100000:0.0:1788832775.877986:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788832775.877994:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994274816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832775.878004:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832775.878029:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d00031400/0xd270a10c1c6a4b4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4b48 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832775.878049:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d00031400/0xd270a10c1c6a4b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b48 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832775.878060:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d00031400/0xd270a10c1c6a4b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b48 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832775.878068:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d00031400, rc 0) 00000100:00100000:0.0:1788832775.878108:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994274816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832775.878114:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788832775.878327:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994274816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832775.878339:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832775.878348:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832775.878402:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994274944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832775.878658:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.878777:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832775.878849:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994274944 00000100:00100000:3.0:1788832775.878854:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994274944 00000100:00100000:3.0:1788832775.878881:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788832775.878888:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994274944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832775.879136:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994274944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832775.879144:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788832775.879457:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994274944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832775.879490:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994275072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832775.879530:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.879560:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832775.879814:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994275072 00000100:00100000:3.0:1788832775.879819:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994275072 00000100:00100000:3.0:1788832775.879841:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788832775.879847:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994275072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832775.880005:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994275072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832775.880033:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788832775.880911:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994275072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832775.882081:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8474:1875726994275200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832775.882150:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832775.882193:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832775.882248:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994275200 00000100:00100000:3.0:1788832775.882255:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994275200 00000100:00100000:3.0:1788832775.882286:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788832775.882294:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+18:8474:x1875726994275200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832775.882533:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+18:8474:x1875726994275200:12345-0@lo:502:llog_process_th.0 Request processed in 239us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832775.882540:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788832775.882720:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8474:1875726994275200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832775.882800:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832775.883772:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832775.883778:0:8474:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788832775.883786:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788832775.883823:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8474:1875726994275328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832775.883881:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832775.883919:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832775.884038:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994275328 00000100:00100000:0.0:1788832775.884045:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994275328 00000100:00100000:0.0:1788832775.884079:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788832775.884087:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+18:8474:x1875726994275328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832775.884303:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+18:8474:x1875726994275328:12345-0@lo:502:llog_process_th.0 Request processed in 216us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832775.884311:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788832775.884834:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8474:1875726994275328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788832775.884863:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832775.884869:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832775.884871:0:8474:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788832775.884875:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788832775.885184:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788832775.885200:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788832775.885209:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832775.885219:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832775.885229:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788832775.885231:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff984d06434d28 from 1 10000000:01000000:0.0:1788832775.885242:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788832775.885270:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4b56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832775.885278:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4b56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832775.885286:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4b56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832775.885302:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994275456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788832775.885339:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832775.885389:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788832775.885652:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994275456 00000100:00100000:3.0:1788832775.885658:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994275456 00000100:00100000:3.0:1788832775.885696:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788832775.885703:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994275456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832775.885714:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832775.885725:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3ada2e00/0xd270a10c1c6a4b5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4b56 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832775.885784:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3ada2e00/0xd270a10c1c6a4b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b56 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832775.885795:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3ada2e00/0xd270a10c1c6a4b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b56 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832775.885803:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2e00, rc 0) 00000100:00100000:3.0:1788832775.885837:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994275456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832775.885843:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788832775.885954:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994275456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832775.885967:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4b56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b5d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832775.885975:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4b56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b5d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832775.886151:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994275584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832775.886188:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832775.886220:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d2da35f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832775.886273:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994275584 00000100:00100000:0.0:1788832775.886278:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994275584 00000100:00100000:0.0:1788832775.886308:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788832775.886322:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994275584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832775.886846:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994275584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 524us (656us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788832775.886854:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788832775.886955:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994275584:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788832775.886983:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788832775.886990:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4b56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b5d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832775.886999:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b5d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832776.026675:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832776.026837:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975373568 00000100:00100000:0.0:1788832776.026847:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975373568 00000100:00100000:0.0:1788832776.026889:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 162 00000100:00100000:0.0:1788832776.026897:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:2360:x1875726975373568:12345-192.168.206.41@tcp:400: 00000100:00100000:0.0:1788832776.026950:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:2360:x1875726975373568:12345-192.168.206.41@tcp:400: Request processed in 54us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832776.026957:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 162 00000100:00100000:0.0:1788832776.035644:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832776.035697:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832776.035734:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832776.035838:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975373696 00000100:00100000:1.0:1788832776.035851:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975373696 00000100:00100000:2.0:1788832776.035925:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975373824 00000100:00100000:2.0:1788832776.035937:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975373824 00000100:00100000:1.0:1788832776.035954:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 26 00000100:00100000:1.0:1788832776.035967:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975373696:12345-192.168.206.41@tcp:400: 00000100:00100000:2.0:1788832776.035997:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975373952 00000100:00100000:2.0:1788832776.036020:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975373952 00000100:00100000:2.0:1788832776.036056:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:1.0:1788832776.036058:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975373696:12345-192.168.206.41@tcp:400: Request processed in 89us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832776.036072:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975373824:12345-192.168.206.41@tcp:400: 00000100:00100000:1.0:1788832776.036086:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 26 00000100:00100000:2.0:1788832776.036143:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975373824:12345-192.168.206.41@tcp:400: Request processed in 73us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832776.036165:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:2.0:1788832776.036187:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:2.0:1788832776.036195:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975373952:12345-192.168.206.41@tcp:400: 00000100:00100000:2.0:1788832776.036222:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975373952:12345-192.168.206.41@tcp:400: Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832776.036229:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00080000:0.0:1788832776.036684:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832776.036690:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788832776.036694:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788832776.790110:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832777.814011:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832778.838966:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832779.414995:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994276224:0@lo:400:kworker.0 00000100:00100000:0.0:1788832779.415057:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832779.415117:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788832779.415124:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994276096:0@lo:400:kworker.0 00000100:00100000:0.0:1788832779.415159:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832779.418818:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994275968:0@lo:400:kworker.0 00000100:00100000:2.0:1788832779.418888:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832779.418934:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994276480:0@lo:400:kworker.0 00000100:00100000:2.0:1788832779.418961:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832779.419011:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788832779.419018:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994275840:0@lo:400:kworker.0 00000100:00100000:2.0:1788832779.419042:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832779.419062:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994275712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832779.419083:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832779.419102:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994276352:0@lo:400:kworker.0 00000100:00100000:2.0:1788832779.419121:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832779.419151:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994276096 00000100:00100000:2.0:1788832779.419170:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994276096 00000100:00100000:2.0:1788832779.419232:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994275968 00000100:00100000:2.0:1788832779.419236:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994275968 00000100:00100000:2.0:1788832779.419250:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994276352 00000100:00100000:2.0:1788832779.419252:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994276352 00000100:00100000:2.0:1788832779.419267:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788832779.419275:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994276096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832779.419327:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994276096:12345-0@lo:400:kworker.0 Request processed in 52us (4167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832779.419334:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788832779.419349:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788832779.419354:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994275968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832779.419386:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994275968:12345-0@lo:400:kworker.0 Request processed in 31us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832779.419392:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788832779.419402:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788832779.419419:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994276352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832779.419446:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994276352:12345-0@lo:400:kworker.0 Request processed in 28us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832779.419452:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788832779.419468:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994275712 00000100:00100000:2.0:1788832779.419472:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994275712 00000100:00100000:2.0:1788832779.419505:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788832779.419511:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994275712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832779.419536:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832779.419564:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994275712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832779.419579:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788832779.419799:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832779.419804:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832779.419818:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994276224 00000100:00100000:1.0:1788832779.419823:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994276224 00000100:00100000:1.0:1788832779.419854:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994276480 00000100:00100000:1.0:1788832779.419858:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994276480 00000100:00100000:1.0:1788832779.419877:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788832779.419882:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994276224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832779.419917:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994276224:12345-0@lo:400:kworker.0 Request processed in 35us (4860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832779.419931:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788832779.419945:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788832779.419951:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994276480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832779.419981:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994276480:12345-0@lo:400:kworker.0 Request processed in 30us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832779.419987:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788832779.420000:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832779.420048:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994276096:0@lo:400:kworker.0 00010000:00080000:1.0:1788832779.420063:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b366300 x1875726994276224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832779.420074:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994276224:0@lo:400:kworker.0 00010000:00080000:2.0:1788832779.420180:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d0647a300 x1875726994275712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832779.420194:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994275712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832779.420203:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994276352:0@lo:400:kworker.0 00000100:00100000:2.0:1788832779.420211:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994275968:0@lo:400:kworker.0 00010000:00080000:2.0:1788832779.420231:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b364e00 x1875726994276480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832779.420239:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994276480:0@lo:400:kworker.0 00000100:00100000:0.0:1788832779.421263:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994275840 00000100:00100000:0.0:1788832779.421271:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994275840 00000100:00100000:0.0:1788832779.421318:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788832779.421326:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994275840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832779.421399:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994275840:12345-0@lo:400:kworker.0 Request processed in 74us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832779.421407:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788832779.422193:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994275840:0@lo:400:kworker.0 00010000:00010000:2.0:1788832779.861953:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832780.885959:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832780.952122:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994276608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832780.952189:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832780.952491:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994276608 00000100:00100000:2.0:1788832780.952499:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994276608 00000100:00100000:2.0:1788832780.952553:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788832780.952562:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994276608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832780.952595:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832780.952642:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994276608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832780.952649:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788832780.952829:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d0647a300 x1875726994276608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832780.952846:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994276608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832781.153118:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832781.153161:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832781.153201:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832781.153245:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832781.153269:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975374464 00000100:00100000:0.0:1788832781.153270:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975374080 00000100:00100000:1.0:1788832781.153278:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975374464 00000100:00100000:0.0:1788832781.153278:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975374080 00000100:00100000:1.0:1788832781.153314:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975374336 00000100:00100000:1.0:1788832781.153317:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975374336 00000100:00100000:0.0:1788832781.153318:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 164 00000100:00100000:0.0:1788832781.153339:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:2357:x1875726975374080:12345-192.168.206.41@tcp:400: 00000100:00100000:1.0:1788832781.153348:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:1.0:1788832781.153354:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2357:x1875726975374464:12345-192.168.206.41@tcp:400: 00000100:00100000:0.0:1788832781.153400:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:2357:x1875726975374080:12345-192.168.206.41@tcp:400: Request processed in 61us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832781.153407:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 164 00000100:00100000:2.0:1788832781.153422:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975374208 00000100:00100000:2.0:1788832781.153426:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975374208 00000100:00100000:2.0:1788832781.153456:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 30 00000100:00100000:2.0:1788832781.153462:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2357:x1875726975374208:12345-192.168.206.41@tcp:400: 00000100:00100000:3.0:1788832781.153901:0:6698:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788832781.153910:0:6698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788832781.154144:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:3.0:1788832781.154154:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2357:x1875726975374336:12345-192.168.206.41@tcp:400: 00000100:00100000:1.0:1788832781.154282:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2357:x1875726975374464:12345-192.168.206.41@tcp:400: Request processed in 926us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832781.154290:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00080000:1.0:1788832781.154309:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832781.154314:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832781.154316:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832781.166225:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2357:x1875726975374336:12345-192.168.206.41@tcp:400: Request processed in 12052us (12958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832781.166240:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:2.0:1788832781.166370:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2357:x1875726975374208:12345-192.168.206.41@tcp:400: Request processed in 12905us (13259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832781.166392:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 30 00000100:00100000:1.0:1788832781.662555:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832781.662692:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975374592 00000100:00100000:2.0:1788832781.662701:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975374592 00000100:00100000:2.0:1788832781.662783:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 165 00000100:00100000:2.0:1788832781.662794:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:5598:x1875726975374592:12345-192.168.206.41@tcp:101: 00010000:00010000:2.0:1788832781.662810:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832781.662845:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b702200/0xd270a10c1c6a4b64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55333 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832781.662874:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b702200/0xd270a10c1c6a4b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55333 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832781.662900:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b702200/0xd270a10c1c6a4b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55333 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832781.662909:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702200, rc 0) 00000100:00100000:2.0:1788832781.662957:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:5598:x1875726975374592:12345-192.168.206.41@tcp:101: Request processed in 165us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832781.662963:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 165 00000100:00100000:1.0:1788832781.665463:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832781.665605:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975374720 00000100:00100000:0.0:1788832781.665614:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975374720 00000100:00100000:0.0:1788832781.665694:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 166 00000100:00100000:0.0:1788832781.665703:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:5598:x1875726975374720:12345-192.168.206.41@tcp:501: 00000100:00100000:0.0:1788832781.666139:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:5598:x1875726975374720:12345-192.168.206.41@tcp:501: Request processed in 435us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832781.666147:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 166 00000100:00100000:1.0:1788832781.671468:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832781.671553:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975374848 00000100:00100000:2.0:1788832781.671562:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975374848 00000100:00100000:2.0:1788832781.671618:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 167 00000100:00100000:2.0:1788832781.671629:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:5598:x1875726975374848:12345-192.168.206.41@tcp:503: 00000100:00100000:2.0:1788832781.672225:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:5598:x1875726975374848:12345-192.168.206.41@tcp:503: Request processed in 596us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832781.672234:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 167 00000100:00100000:1.0:1788832781.692074:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832781.693811:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975374976 00000100:00100000:0.0:1788832781.693830:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975374976 00000100:00100000:0.0:1788832781.693916:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 168 00000100:00100000:0.0:1788832781.693928:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:6102:x1875726975374976:12345-192.168.206.41@tcp:502: 00000100:00100000:0.0:1788832781.694297:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:6102:x1875726975374976:12345-192.168.206.41@tcp:502: Request processed in 369us (2235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832781.694306:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 168 00000100:00100000:1.0:1788832781.703329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832781.703480:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975375104 00000100:00100000:3.0:1788832781.703493:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975375104 00000100:00100000:3.0:1788832781.703565:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 169 00000100:00100000:3.0:1788832781.703577:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:6102:x1875726975375104:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788832781.703983:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:6102:x1875726975375104:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 407us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832781.703993:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 169 00000100:00100000:1.0:1788832781.709860:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832781.710098:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975375232 00000100:00100000:2.0:1788832781.710126:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975375232 00000100:00100000:2.0:1788832781.710185:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 170 00000100:00100000:2.0:1788832781.710196:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:5598:x1875726975375232:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832781.710228:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832781.710253:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b703200/0xd270a10c1c6a4b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5533a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832781.710288:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b703200/0xd270a10c1c6a4b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5533a expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832781.710301:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b703200/0xd270a10c1c6a4b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5533a expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832781.710324:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703200, rc 0) 00000100:00100000:2.0:1788832781.710400:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5598:x1875726975375232:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 Request processed in 205us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832781.710407:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 170 00000100:00100000:1.0:1788832781.718951:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832781.719064:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975375360 00000100:00100000:0.0:1788832781.719093:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975375360 00000100:00100000:0.0:1788832781.719149:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 171 00000100:00100000:0.0:1788832781.719159:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5598:x1875726975375360:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832781.719897:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5598:x1875726975375360:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 Request processed in 733us (954us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788832781.719908:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 171 00010000:00010000:2.0:1788832781.910272:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788832782.899948:0:8512:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdca99ea90 20000000:00000080:2.0:1788832782.899972:0:8512:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984d3ba13c00 uarg=0000000000000000 20000000:01000000:2.0:1788832782.900015:0:8512:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788832782.900022:0:8512:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788832782.900027:0:8512:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788832782.901229:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788832782.901415:0:8512:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788832782.906372:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788832782.906429:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788832782.906487:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788832782.906505:0:8512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788832782.906530:0:8512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.906558:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a48e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a48e0 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.906567:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d05f05200/0xd270a10c1c6a4949 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4942 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.906575:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d00030e00/0xd270a10c1c6a4a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4a0d expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.906584:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4ad1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55302 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.906591:0:8512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.906634:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4ad1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55302 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.906650:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4ad1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55302 expref: 9 pid: 5848 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832782.906666:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875726994276736:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832782.906843:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d00030e00/0xd270a10c1c6a4a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4a0d expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.906853:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d00030e00/0xd270a10c1c6a4a14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a0d expref: 18 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832782.906862:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875726994276864:0@lo:104: 00000100:00100000:2.0:1788832782.906913:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832782.906947:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d05f05200/0xd270a10c1c6a4949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4942 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.906955:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d05f05200/0xd270a10c1c6a4949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4942 expref: 18 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832782.906963:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875726994276992:0@lo:104: 00000100:00100000:2.0:1788832782.906983:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832782.907002:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a48e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a48e0 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.907010:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a48e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a48e0 expref: 18 pid: 5847 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832782.907019:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875726994277120:0@lo:104: 00000100:00100000:2.0:1788832782.907037:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c0627a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788832782.907182:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788832782.907211:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832782.907227:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994276864 00000100:00100000:0.0:1788832782.907235:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994276864 00000100:00100000:0.0:1788832782.907278:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994276992 00000100:00100000:0.0:1788832782.907281:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994276992 00000100:00100000:0.0:1788832782.907291:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994277120 00000100:00100000:0.0:1788832782.907293:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994277120 00000100:00100000:0.0:1788832782.907307:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788832782.907315:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+5:8512:x1875726994276864:12345-0@lo:104: 00010000:00010000:0.0:1788832782.907328:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4a14 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907397:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788832782.907403:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+5:8512:x1875726994276864:12345-0@lo:104: Request processed in 89us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832782.907411:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788832782.907432:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788832782.907438:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c06602850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+4:8512:x1875726994276992:12345-0@lo:104: 00010000:00010000:0.0:1788832782.907446:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4949 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907494:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788832782.907499:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c06602850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+4:8512:x1875726994276992:12345-0@lo:104: Request processed in 61us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832782.907505:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788832782.907540:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788832782.907546:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b366680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:8512:x1875726994277120:12345-0@lo:104: 00010000:00010000:0.0:1788832782.907554:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d05f04c00/0xd270a10c1c6a48e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a48e7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907586:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788832782.907591:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b366680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:8512:x1875726994277120:12345-0@lo:104: Request processed in 46us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832782.907596:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788832782.907614:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788832782.907620:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4a14 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907627:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788832782.907631:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4a14 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907640:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4a14 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832782.907648:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4a14 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832782.907654:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788832782.907696:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a14 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907704:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832782.907726:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a14 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907733:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4a0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4a14 expref: -99 pid: 7633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907775:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788832782.907779:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4949 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907785:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d013d0e00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788832782.907789:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4949 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907795:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4949 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832782.907801:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4949 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832782.907806:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788832782.907819:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4949 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907826:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832782.907843:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4949 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907861:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4942 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4949 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907871:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832782.907874:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d05f04c00/0xd270a10c1c6a48e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a48e7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907879:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788832782.907882:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d05f04c00/0xd270a10c1c6a48e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a48e7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907888:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d05f04c00/0xd270a10c1c6a48e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a48e7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832782.907894:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d05f04c00/0xd270a10c1c6a48e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a48e7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832782.907900:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788832782.907913:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d05f04c00/0xd270a10c1c6a48e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a48e7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907918:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832782.907924:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d05f04c00/0xd270a10c1c6a48e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a48e7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907929:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d05f04c00/0xd270a10c1c6a48e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a48e7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.907942:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832782.907949:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832782.907951:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832782.907958:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832782.907963:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832782.907975:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994277248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832782.908005:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832782.908048:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994277376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832782.908068:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832782.908088:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832782.908094:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994277504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832782.908113:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832782.908144:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994277248 00000100:00100000:0.0:1788832782.908149:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994277248 00010000:00010000:0.0:1788832782.908170:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d00030e00/0xd270a10c1c6a4a14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a0d expref: 19 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832782.908191:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994277376 00000100:00100000:0.0:1788832782.908194:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994277376 00010000:00010000:0.0:1788832782.908218:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d05f05200/0xd270a10c1c6a4949 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4942 expref: 20 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832782.908229:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994277504 00000100:00100000:0.0:1788832782.908231:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994277504 00010000:00010000:0.0:1788832782.908244:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a48e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a48e0 expref: 21 pid: 5847 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832782.908257:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788832782.908263:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b365c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+21:3317:x1875726994277248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832782.908274:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832782.908285:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d00030e00/0xd270a10c1c6a4a14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a0d expref: 21 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.908294:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d00030e00/0xd270a10c1c6a4a14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4a0d expref: 21 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.908311:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832782.908342:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b365c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+21:3317:x1875726994277248:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832782.908348:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788832782.908363:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788832782.908369:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b366300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+20:3314:x1875726994277376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832782.908376:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832782.908381:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d05f05200/0xd270a10c1c6a4949 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4942 expref: 20 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.908388:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d05f05200/0xd270a10c1c6a4949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4942 expref: 20 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.908397:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832782.908421:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b366300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+20:3314:x1875726994277376:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832782.908427:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788832782.908439:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788832782.908445:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b364000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994277504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832782.908452:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832782.908455:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a48e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a48e0 expref: 19 pid: 5847 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.908473:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a48e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a48e0 expref: 19 pid: 5847 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832782.908482:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832782.908504:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b364000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994277504:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832782.908511:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788832782.908558:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994277248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832782.908586:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994277504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832782.908593:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994277376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832782.910188:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d00030e00/0xd270a10c1c6a4a14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4a0d expref: 18 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832782.910217:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875726994276864:0@lo:104: 00010000:00010000:2.0:1788832782.910231:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d05f05200/0xd270a10c1c6a4949 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4942 expref: 17 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832782.910238:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875726994276992:0@lo:104: 00010000:00010000:2.0:1788832782.910247:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a48e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a48e0 expref: 16 pid: 5847 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832782.910255:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875726994277120:0@lo:104: 00000100:00100000:2.0:1788832782.912183:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875726994276736:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832782.912240:0:8512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832782.913923:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832782.914060:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975375488 00000100:00100000:2.0:1788832782.914071:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975375488 00010000:00010000:2.0:1788832782.914117:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4ad1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55302 expref: 10 pid: 5848 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832782.914174:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 24 00000100:00100000:2.0:1788832782.914184:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2358:x1875726975375488:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832782.914212:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832782.914219:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4ad1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55302 expref: 10 pid: 5848 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.914233:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4ad1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55302 expref: 10 pid: 5848 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.914254:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4ad1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55302 expref: 10 pid: 5848 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.914275:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.914284:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.914302:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.914330:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.914336:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.914343:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.914349:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788832782.914353:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.914361:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.914373:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832782.914385:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832782.914445:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:2358:x1875726975375488:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 261us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832782.914453:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 24 00010000:00010000:3.0:1788832782.914619:0:8512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832782.914629:0:8512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832782.914635:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b703600/0xd270a10c1c6a4b72 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832782.938295:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832783.155610:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832783.156632:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975375616 00000100:00100000:3.0:1788832783.156651:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975375616 00000100:00100000:0.0:1788832783.156775:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 172 00000100:00100000:0.0:1788832783.156797:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:5598:x1875726975375616:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832783.156823:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832783.156850:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d00030600/0xd270a10c1c6a4b79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55341 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832783.156888:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d00030600/0xd270a10c1c6a4b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55341 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832783.156901:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d00030600/0xd270a10c1c6a4b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55341 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832783.156913:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d00030600, rc 0) 00000100:00100000:0.0:1788832783.156991:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5598:x1875726975375616:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 Request processed in 204us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832783.157018:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 172 00000100:00100000:0.0:1788832783.160539:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832783.160854:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975375744 00000100:00100000:1.0:1788832783.160943:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975375744 00000100:00100000:1.0:1788832783.161015:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 173 00000100:00100000:1.0:1788832783.161027:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5598:x1875726975375744:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832783.162394:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5598:x1875726975375744:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 Request processed in 1360us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832783.162409:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 173 00000100:00100000:1.0:1788832783.166490:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832783.166608:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975375872 00000100:00100000:0.0:1788832783.166621:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975375872 00000100:00100000:0.0:1788832783.166697:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 174 00000100:00100000:0.0:1788832783.166708:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5598:x1875726975375872:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832783.167026:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:5598:x1875726975375872:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 Request processed in 319us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832783.167035:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 174 00000100:00100000:2.0:1788832783.180389:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832783.180506:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975376000 00000100:00100000:1.0:1788832783.180527:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975376000 00000100:00100000:1.0:1788832783.180583:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 175 00000100:00100000:1.0:1788832783.180593:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:6148:x1875726975376000:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788832783.180847:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:6148:x1875726975376000:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 255us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832783.180855:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 175 00000100:00100000:3.0:1788832783.187627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832783.187714:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975376128 00000100:00100000:2.0:1788832783.187722:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975376128 00000100:00100000:1.0:1788832783.187911:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 176 00000100:00100000:1.0:1788832783.187922:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:6148:x1875726975376128:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788832783.188134:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:6148:x1875726975376128:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 214us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832783.188142:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 176 00010000:00010000:1.0:1788832783.958837:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788832784.022152:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788832784.022159:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d07487000 from 4 10000000:01000000:3.0:1788832784.022164:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788832784.022224:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832784.022236:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832784.022246:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832784.022273:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994277632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788832784.022339:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832784.022393:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832784.022443:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994277632 00000100:00100000:0.0:1788832784.022451:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994277632 00000100:00100000:0.0:1788832784.022507:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788832784.022518:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994277632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832784.022531:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832784.022544:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d00030200/0xd270a10c1c6a4b87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4b80 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832784.022567:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d00030200/0xd270a10c1c6a4b87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b80 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832784.022577:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d00030200/0xd270a10c1c6a4b87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b80 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832784.022596:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d00030200, rc 0) 00000100:00100000:0.0:1788832784.022643:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994277632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832784.022649:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788832784.022830:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994277632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832784.022843:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b87 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832784.022863:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b87 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832784.022923:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994277760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832784.022949:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832784.022966:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b023c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832784.023115:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994277760 00000100:00100000:1.0:1788832784.023119:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994277760 00000100:00100000:1.0:1788832784.023153:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788832784.023159:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994277760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832784.023394:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994277760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832784.023400:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788832784.023427:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994277760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832784.023452:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994277888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832784.023487:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832784.023499:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832784.023508:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994277888 00000100:00100000:1.0:1788832784.023511:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994277888 00000100:00100000:1.0:1788832784.023530:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788832784.023536:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994277888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832784.023671:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994277888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832784.023677:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788832784.023710:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994277888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832784.044024:0:8564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8564:1875726994278016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832784.044111:0:8564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832784.044146:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994278016 00000100:00100000:0.0:1788832784.044814:0:8564:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832784.045460:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994278016 00000100:00100000:1.0:1788832784.045520:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788832784.045530:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:8564:x1875726994278016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832784.045770:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:8564:x1875726994278016:12345-0@lo:502:llog_process_th.0 Request processed in 241us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832784.045778:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788832784.045827:0:8564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8564:1875726994278016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788832784.045863:0:8564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832784.045873:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832784.045875:0:8564:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788832784.045980:0:8564:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984d07487000 00000020:00000080:0.0:1788832784.045985:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788832784.046065:0:8564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8564:1875726994278144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832784.046110:0:8564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832784.046152:0:8564:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10c97cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832784.046281:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994278144 00000100:00100000:1.0:1788832784.046287:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994278144 00000100:00100000:1.0:1788832784.046321:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788832784.046329:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+17:8564:x1875726994278144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832784.046518:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+17:8564:x1875726994278144:12345-0@lo:502:llog_process_th.0 Request processed in 189us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832784.046525:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788832784.052047:0:8564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8564:1875726994278144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788832784.052095:0:8564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832784.052104:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832784.052106:0:8564:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788832784.052111:0:8564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788832784.052313:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788832784.052336:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788832784.052346:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b87 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832784.052365:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b87 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832784.052375:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788832784.052378:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d39f1a000 from 4 10000000:01000000:1.0:1788832784.052381:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788832784.052410:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832784.052418:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832784.052427:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832784.052447:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994278272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788832784.052509:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832784.052580:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788832784.052615:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994278272 00000100:00100000:0.0:1788832784.052621:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994278272 00000100:00100000:0.0:1788832784.052694:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788832784.052704:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994278272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832784.052717:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832784.052729:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d00031e00/0xd270a10c1c6a4b95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4b8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832784.052771:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d00031e00/0xd270a10c1c6a4b95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b8e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832784.052782:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d00031e00/0xd270a10c1c6a4b95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b8e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832784.052801:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d00031e00, rc 0) 00000100:00100000:0.0:1788832784.052844:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994278272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832784.052851:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788832784.052924:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994278272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832784.052935:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b95 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832784.052943:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b95 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832784.052984:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994278400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832784.053011:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832784.053054:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788832784.053068:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994278400 00000100:00100000:1.0:1788832784.053072:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994278400 00000100:00100000:1.0:1788832784.053097:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788832784.053105:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994278400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832784.053355:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994278400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832784.053363:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788832784.053455:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994278400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832784.053484:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994278528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832784.053521:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832784.053536:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788832784.053548:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994278528 00000100:00100000:1.0:1788832784.053551:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994278528 00000100:00100000:1.0:1788832784.053570:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788832784.053577:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994278528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832784.053712:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994278528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832784.053718:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788832784.056356:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994278528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832784.056555:0:8567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8567:1875726994278656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832784.056694:0:8567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832784.056739:0:8567:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d02a9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788832784.056788:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994278656 00000100:00100000:0.0:1788832784.056795:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994278656 00000100:00100000:0.0:1788832784.056833:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788832784.056842:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:8567:x1875726994278656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832784.057019:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:8567:x1875726994278656:12345-0@lo:502:llog_process_th.0 Request processed in 177us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832784.057026:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788832784.059763:0:8567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8567:1875726994278656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832784.059817:0:8567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832784.059827:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832784.059829:0:8567:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788832784.059837:0:8567:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984d39f1a000 00000020:00000080:2.0:1788832784.059839:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788832784.060724:0:8567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8567:1875726994278784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832784.060823:0:8567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832784.060865:0:8567:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d02a9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788832784.061312:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994278784 00000100:00100000:0.0:1788832784.061319:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994278784 00000100:00100000:0.0:1788832784.061358:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788832784.061367:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:8567:x1875726994278784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832784.061715:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:8567:x1875726994278784:12345-0@lo:502:llog_process_th.0 Request processed in 347us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832784.061724:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788832784.064023:0:8567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8567:1875726994278784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832784.064066:0:8567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832784.064075:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832784.064077:0:8567:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788832784.064082:0:8567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788832784.066937:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788832784.066968:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832784.066979:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b95 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832784.066992:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b95 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832784.067021:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788832784.067024:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d2a26c800 from 4 10000000:01000000:0.0:1788832784.067026:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788832784.067064:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832784.067072:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832784.067082:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832784.067105:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994278912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788832784.067164:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832784.067233:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994278912 00000100:00100000:0.0:1788832784.067234:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10c97900 going to sleep for 11 seconds 00000100:00100000:1.0:1788832784.067242:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994278912 00000100:00100000:1.0:1788832784.067295:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788832784.067303:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994278912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832784.067317:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832784.067330:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d05f05000/0xd270a10c1c6a4ba3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4b9c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832784.067365:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d05f05000/0xd270a10c1c6a4ba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b9c expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832784.067377:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d05f05000/0xd270a10c1c6a4ba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b9c expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832784.067386:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05000, rc 0) 00000100:00100000:1.0:1788832784.067438:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994278912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832784.067446:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788832784.069355:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994278912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832784.069377:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4ba3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832784.069389:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4ba3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832784.069468:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994279040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832784.069519:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832784.069560:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10c97900 going to sleep for 11 seconds 00000100:00100000:3.0:1788832784.070837:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994279040 00000100:00100000:3.0:1788832784.070847:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994279040 00000100:00100000:3.0:1788832784.071101:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788832784.071111:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994279040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832784.071379:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994279040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832784.071388:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788832784.073950:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994279040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832784.074007:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994279168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832784.074136:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832784.074178:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10c97900 going to sleep for 11 seconds 00000100:00100000:0.0:1788832784.074225:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994279168 00000100:00100000:0.0:1788832784.074231:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994279168 00000100:00100000:0.0:1788832784.074270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788832784.074279:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994279168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832784.074458:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994279168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832784.074466:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788832784.074510:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994279168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832784.078927:0:8572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a570e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8572:1875726994279296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832784.079007:0:8572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832784.079047:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994279296 00000100:00100000:3.0:1788832784.079055:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994279296 00000100:00100000:3.0:1788832784.079095:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788832784.079105:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:8572:x1875726994279296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832784.079351:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:8572:x1875726994279296:12345-0@lo:502:llog_process_th.0 Request processed in 247us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832784.079359:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788832784.079421:0:8572:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10363180 going to sleep for 11 seconds 00000100:00100000:3.0:1788832784.079440:0:8572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a570e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8572:1875726994279296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788832784.079477:0:8572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832784.079485:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832784.079488:0:8572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788832784.079497:0:8572:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984d2a26c800 00000020:00000080:3.0:1788832784.079500:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788832784.079574:0:8572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a570e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8572:1875726994279424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832784.079610:0:8572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832784.079631:0:8572:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10363180 going to sleep for 11 seconds 00000100:00100000:0.0:1788832784.079669:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994279424 00000100:00100000:0.0:1788832784.079675:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994279424 00000100:00100000:0.0:1788832784.079711:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788832784.079719:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:8572:x1875726994279424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832784.079870:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:8572:x1875726994279424:12345-0@lo:502:llog_process_th.0 Request processed in 152us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832784.079878:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788832784.079954:0:8572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a570e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:8572:1875726994279424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788832784.079978:0:8572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832784.079983:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832784.079985:0:8572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788832784.079989:0:8572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788832784.080050:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788832784.080074:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788832784.080082:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4ba3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832784.080093:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4ba3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832784.536832:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994279552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832784.536904:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832784.536987:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994279552 00000100:00100000:0.0:1788832784.536994:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994279552 00000100:00100000:0.0:1788832784.537047:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788832784.537057:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994279552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832784.537091:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832784.537135:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994279552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832784.537151:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788832784.537185:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788832784.537235:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a9bdc00 x1875726994279552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832784.537254:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994279552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832784.537636:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994279808:0@lo:400:kworker.0 00000100:00100000:0.0:1788832784.537666:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832784.537694:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832784.537701:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994279936:0@lo:400:kworker.0 00000100:00100000:0.0:1788832784.537724:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832784.537781:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994279808 00000100:00100000:0.0:1788832784.537786:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994279808 00000100:00100000:0.0:1788832784.537811:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994279936 00000100:00100000:0.0:1788832784.537814:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994279936 00000100:00100000:0.0:1788832784.537837:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788832784.537844:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994279808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832784.537881:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994279808:12345-0@lo:400:kworker.0 Request processed in 37us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832784.537888:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788832784.537901:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788832784.537907:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994279936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832784.537935:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994279936:12345-0@lo:400:kworker.0 Request processed in 29us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832784.537940:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788832784.537963:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994279680:0@lo:400:kworker.0 00000100:00100000:0.0:1788832784.537999:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832784.538027:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994280192:0@lo:400:kworker.0 00000100:00100000:0.0:1788832784.538047:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832784.538061:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788832784.538066:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994280064:0@lo:400:kworker.0 00000100:00100000:0.0:1788832784.538085:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832784.538122:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994279680 00000100:00100000:0.0:1788832784.538125:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994279680 00000100:00100000:0.0:1788832784.538149:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788832784.538156:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994279680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832784.538322:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994280192 00000100:00100000:2.0:1788832784.538326:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994280192 00000100:00100000:2.0:1788832784.538353:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788832784.538361:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994280192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832784.538400:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994280192:12345-0@lo:400:kworker.0 Request processed in 39us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832784.538407:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788832784.538582:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994279680:12345-0@lo:400:kworker.0 Request processed in 426us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832784.538589:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788832784.538618:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994280064 00000100:00100000:0.0:1788832784.538622:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994280064 00000100:00100000:0.0:1788832784.538691:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788832784.538698:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994280064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832784.538729:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994280064:12345-0@lo:400:kworker.0 Request processed in 33us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832784.538735:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788832784.540475:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832784.540483:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832784.540526:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994279936:0@lo:400:kworker.0 00000100:00100000:1.0:1788832784.540541:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994279808:0@lo:400:kworker.0 00010000:00080000:0.0:1788832784.541407:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a9bdf80 x1875726994280064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832784.541420:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994280064:0@lo:400:kworker.0 00000100:00100000:0.0:1788832784.541431:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994279680:0@lo:400:kworker.0 00000100:00100000:0.0:1788832784.541441:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994280192:0@lo:400:kworker.0 00010000:00010000:0.0:1788832784.981997:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832786.005889:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832786.070266:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788832786.070288:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994280320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832786.070358:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832786.070587:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994280320 00000100:00100000:2.0:1788832786.070605:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994280320 00000100:00100000:2.0:1788832786.070662:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788832786.070671:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994280320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832786.070717:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832786.070777:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994280320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832786.070784:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788832786.070891:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788832786.070918:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a9bc000 x1875726994280320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832786.070945:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994280320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832786.267930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832786.267974:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832786.268009:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832786.268032:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832786.268057:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975376384 00000100:00100000:3.0:1788832786.268065:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975376384 00000100:00100000:3.0:1788832786.268120:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 34 00000100:00100000:3.0:1788832786.268130:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975376384:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832786.268205:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975376384:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 76us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832786.268213:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 34 00000100:00100000:3.0:1788832786.268235:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975376512 00000100:00100000:3.0:1788832786.268238:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975376512 00000100:00100000:3.0:1788832786.268263:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975376640 00000100:00100000:3.0:1788832786.268266:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975376640 00000100:00100000:3.0:1788832786.268285:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 18 00000100:00100000:3.0:1788832786.268291:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975376512:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832786.268319:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975376512:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832786.268325:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 18 00000100:00100000:3.0:1788832786.268337:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 19 00000100:00100000:0.0:1788832786.268761:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975376256 00000100:00100000:0.0:1788832786.268766:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975376256 00000100:00100000:0.0:1788832786.268796:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 193 00000100:00100000:0.0:1788832786.268804:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2360:x1875726975376256:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832786.268832:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2360:x1875726975376256:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 29us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832786.268839:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 193 00000100:00100000:3.0:1788832786.269237:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975376640:12345-192.168.206.41@tcp:400:kworker.0 00000100:00080000:1.0:1788832786.269258:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832786.269265:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832786.269268:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832786.269276:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975376640:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 932us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832786.269297:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 19 00010000:00010000:1.0:1788832787.030168:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832788.055404:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832789.078324:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788832789.561279:0:8811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1788832789.656634:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994280448:0@lo:400:kworker.0 00000100:00100000:2.0:1788832789.656703:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832789.658767:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994280960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832789.658821:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832789.658850:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832789.658856:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994280832:0@lo:400:kworker.0 00000100:00100000:2.0:1788832789.658881:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832789.658917:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994280960 00000100:00100000:2.0:1788832789.658924:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994280960 00000100:00100000:2.0:1788832789.658971:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788832789.658979:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994280960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832789.659008:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832789.659046:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994280960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832789.659053:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788832789.659072:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994280832 00000100:00100000:2.0:1788832789.659076:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994280832 00000100:00100000:2.0:1788832789.659112:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788832789.659118:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994280832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832789.659147:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994280832:12345-0@lo:400:kworker.0 Request processed in 30us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832789.659153:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788832789.659187:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832789.659190:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788832789.659216:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b366a00 x1875726994280832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832789.659228:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994280832:0@lo:400:kworker.0 00010000:00080000:2.0:1788832789.659239:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b79d180 x1875726994280960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832789.659251:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994280960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832789.662498:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994280448 00000100:00100000:0.0:1788832789.662507:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994280448 00000100:00100000:0.0:1788832789.662551:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788832789.662561:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994280448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832789.662649:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994280448:12345-0@lo:400:kworker.0 Request processed in 89us (5945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832789.662656:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788832789.662699:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994280576:0@lo:400:kworker.0 00000100:00100000:0.0:1788832789.662734:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832789.662777:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994281088:0@lo:400:kworker.0 00000100:00100000:0.0:1788832789.662799:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832789.662818:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832789.662823:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994280704:0@lo:400:kworker.0 00000100:00100000:0.0:1788832789.662857:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832789.662893:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994280576 00000100:00100000:0.0:1788832789.662897:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994280576 00000100:00100000:0.0:1788832789.662921:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994281088 00000100:00100000:0.0:1788832789.662924:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994281088 00000100:00100000:0.0:1788832789.662953:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994280704 00000100:00100000:0.0:1788832789.662956:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994280704 00000100:00100000:0.0:1788832789.662969:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788832789.662975:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994280576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832789.663014:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994280576:12345-0@lo:400:kworker.0 Request processed in 38us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832789.663021:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788832789.663032:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788832789.663038:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994281088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832789.663062:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994281088:12345-0@lo:400:kworker.0 Request processed in 24us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832789.663067:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788832789.663077:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788832789.663688:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994280704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832789.663760:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994280704:12345-0@lo:400:kworker.0 Request processed in 658us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832789.663768:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788832789.663797:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832789.663825:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994280704:0@lo:400:kworker.0 00000100:00100000:0.0:1788832789.663835:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994280576:0@lo:400:kworker.0 00000100:00100000:0.0:1788832789.663844:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994281088:0@lo:400:kworker.0 00000100:00100000:3.0:1788832789.664887:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994280448:0@lo:400:kworker.0 00010000:00010000:1.0:1788832790.101981:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832791.126837:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832791.203286:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994281216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832791.203354:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832791.203636:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994281216 00000100:00100000:0.0:1788832791.203644:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994281216 00000100:00100000:0.0:1788832791.203700:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788832791.203797:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994281216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832791.203830:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832791.203876:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994281216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832791.203884:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788832791.203906:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788832791.203935:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b714000 x1875726994281216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832791.203953:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994281216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832791.399007:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832791.399066:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832791.399177:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975376896 00000100:00100000:0.0:1788832791.399187:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975376896 00000100:00100000:0.0:1788832791.399263:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 38 00000100:00100000:0.0:1788832791.399273:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975376896:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832791.399357:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975376896:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 85us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832791.399365:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 38 00000100:00100000:1.0:1788832791.399623:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975376768 00000100:00100000:1.0:1788832791.399629:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975376768 00000100:00100000:1.0:1788832791.399666:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 195 00000100:00100000:1.0:1788832791.399674:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2359:x1875726975376768:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832791.399707:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2359:x1875726975376768:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 34us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832791.399727:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 195 00000100:00080000:2.0:1788832791.400126:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832791.408815:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832791.408914:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975377024 00000100:00100000:1.0:1788832791.408924:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975377024 00000100:00100000:1.0:1788832791.409000:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00100000:1.0:1788832791.409010:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2356:x1875726975377024:12345-192.168.206.41@tcp:9:kworker.0 00000020:00000080:1.0:1788832791.409055:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4adf 00000100:00080000:1.0:1788832791.409065:0:6700:0:(import.c:65:import_set_state_nolock()) ffff984d3de71800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788832791.409112:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788832791.409486:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+2:2356:x1875726975377024:12345-192.168.206.41@tcp:9:kworker.0 Request processed in 476us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832791.409495:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00080000:2.0:1788832791.409723:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788832791.409850:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832791.414618:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832791.414700:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975377152 00000100:00100000:2.0:1788832791.414710:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975377152 00000100:00100000:2.0:1788832791.414801:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:2.0:1788832791.414810:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2356:x1875726975377152:12345-192.168.206.41@tcp:9:kworker.0 00000020:00000080:2.0:1788832791.414845:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4ae6 00000100:00080000:2.0:1788832791.414854:0:6699:0:(import.c:65:import_set_state_nolock()) ffff984d3de71000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788832791.414902:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1788832791.415290:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832791.415606:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+2:2356:x1875726975377152:12345-192.168.206.41@tcp:9:kworker.0 Request processed in 795us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832791.415615:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00080000:0.0:1788832791.415767:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788832792.150888:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832793.174483:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788832793.308250:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bee6676f-b533-4465-8162-bf8b5e1e90e6 00000020:00000080:2.0:1788832793.308260:0:6724:0:(genops.c:885:class_export_put()) final put ffff984d3de77800/bee6676f-b533-4465-8162-bf8b5e1e90e6 00000020:00000080:3.0:1788832793.308424:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3de77800/bee6676f-b533-4465-8162-bf8b5e1e90e6 for lustre-OST0000 00000020:00000080:3.0:1788832793.308486:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984d3de71800 for lustre-OST0000 00010000:00010000:3.0:1788832794.197940:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832794.775277:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994281472:0@lo:400:kworker.0 00000100:00100000:3.0:1788832794.775360:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832794.775425:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994281984:0@lo:400:kworker.0 00000100:00100000:3.0:1788832794.775473:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832794.775531:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788832794.775538:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994281344:0@lo:400:kworker.0 00000100:00100000:3.0:1788832794.775572:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832794.775593:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994281856:0@lo:400:kworker.0 00000100:00100000:3.0:1788832794.775615:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832794.775646:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994281984 00000100:00100000:3.0:1788832794.775655:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994281984 00000100:00100000:3.0:1788832794.775727:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788832794.775738:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c0547aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994281984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832794.775819:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c0547aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994281984:12345-0@lo:400:kworker.0 Request processed in 84us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832794.775827:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788832794.775875:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a571c00 x1875726994281984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832794.775891:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994281984:0@lo:400:kworker.0 00000100:00100000:0.0:1788832794.776214:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994281600:0@lo:400:kworker.0 00000100:00100000:0.0:1788832794.776251:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832794.776283:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832794.776290:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994281728:0@lo:400:kworker.0 00000100:00100000:0.0:1788832794.776314:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832794.776357:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994281472 00000100:00100000:0.0:1788832794.776371:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994281472 00000100:00100000:0.0:1788832794.776406:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994281856 00000100:00100000:0.0:1788832794.776421:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994281856 00000100:00100000:0.0:1788832794.776439:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994281600 00000100:00100000:0.0:1788832794.776441:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994281600 00000100:00100000:0.0:1788832794.776455:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788832794.776460:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994281472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832794.776517:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994281472:12345-0@lo:400:kworker.0 Request processed in 55us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832794.776523:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788832794.776541:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788832794.776547:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994281856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832794.776576:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994281856:12345-0@lo:400:kworker.0 Request processed in 29us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832794.776587:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788832794.776600:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788832794.776606:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994281600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832794.776635:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994281600:12345-0@lo:400:kworker.0 Request processed in 30us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832794.776641:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788832794.776661:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994281344 00000100:00100000:0.0:1788832794.776665:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994281344 00000100:00100000:0.0:1788832794.776689:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788832794.776696:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994281344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832794.776728:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994281344:12345-0@lo:400:kworker.0 Request processed in 32us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832794.776734:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:0.0:1788832794.776807:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832794.776813:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832794.776823:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994281728 00000100:00100000:0.0:1788832794.776827:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994281728 00000100:00100000:0.0:1788832794.776859:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788832794.776865:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994281728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832794.776896:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994281728:12345-0@lo:400:kworker.0 Request processed in 31us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832794.776902:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788832794.776944:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a572680 x1875726994281728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832794.776956:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994281728:0@lo:400:kworker.0 00000100:00100000:0.0:1788832794.776969:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994281600:0@lo:400:kworker.0 00000100:00100000:0.0:1788832794.776998:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994281344:0@lo:400:kworker.0 00000100:00100000:0.0:1788832794.777009:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994281856:0@lo:400:kworker.0 00000100:00080000:3.0:1788832794.777017:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832794.777019:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994281472:0@lo:400:kworker.0 00000100:00100000:3.0:1788832794.781262:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788832794.781292:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994282112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832794.781383:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832794.781603:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994282112 00000100:00100000:0.0:1788832794.781614:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994282112 00000100:00100000:0.0:1788832794.781678:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788832794.781690:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994282112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832794.781733:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832794.781831:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994282112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832794.781838:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788832794.781934:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b717480 x1875726994282112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832794.781955:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994282112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788832795.223549:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788832795.353050:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bee6676f-b533-4465-8162-bf8b5e1e90e6 00000020:00000080:0.0:1788832795.353062:0:7651:0:(genops.c:885:class_export_put()) final put ffff984d3de77000/bee6676f-b533-4465-8162-bf8b5e1e90e6 00000020:00000080:0.0:1788832795.353084:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3de77000/bee6676f-b533-4465-8162-bf8b5e1e90e6 for lustre-OST0001 00000020:00000080:0.0:1788832795.353119:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984d3de71000 for lustre-OST0001 00000001:02000400:0.0:1788832795.406963:0:9059:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-server.virtnet: executing yml_node 00010000:00010000:0.0:1788832796.246053:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832796.310910:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832796.310934:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994282240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832796.311017:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832796.311082:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994282240 00000100:00100000:0.0:1788832796.311089:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994282240 00000100:00100000:0.0:1788832796.311150:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788832796.311159:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994282240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832796.311191:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832796.311234:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994282240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832796.311240:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788832796.311280:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b715f80 x1875726994282240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832796.311298:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994282240:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788832796.311409:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832796.511105:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832796.511167:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832796.511167:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975377408 00000100:00100000:1.0:1788832796.511176:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975377408 00000100:00080000:3.0:1788832796.511204:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832796.511226:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 42 00000100:00100000:1.0:1788832796.511236:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c0547ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975377408:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832796.511302:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c0547ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975377408:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832796.512509:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975377280 00000100:00100000:0.0:1788832796.512518:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975377280 00000100:00100000:0.0:1788832796.512568:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 197 00000100:00100000:0.0:1788832796.512577:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2358:x1875726975377280:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832796.512986:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2358:x1875726975377280:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 408us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832796.512995:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 197 00000100:00100000:1.0:1788832796.513937:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 42 00010000:00010000:3.0:1788832797.270389:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832798.293974:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832799.318960:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832799.894463:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994282368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832799.894527:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832799.894596:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994282368 00000100:00100000:0.0:1788832799.894602:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994282368 00000100:00100000:1.0:1788832799.894714:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994282752:0@lo:400:kworker.0 00000100:00100000:1.0:1788832799.894779:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832799.894803:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832799.894809:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994282624:0@lo:400:kworker.0 00000100:00100000:1.0:1788832799.894831:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832799.894869:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994282496:0@lo:400:kworker.0 00000100:00100000:1.0:1788832799.894896:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832799.894929:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994283008:0@lo:400:kworker.0 00000100:00100000:1.0:1788832799.894950:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832799.896387:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788832799.896399:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994282368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832799.896431:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832799.896484:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994282368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832799.896492:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788832799.896786:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832799.896795:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994282880:0@lo:400:kworker.0 00000100:00100000:1.0:1788832799.896828:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788832799.898669:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b715f80 x1875726994282368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832799.898694:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994282368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832799.898762:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994282496 00000100:00100000:1.0:1788832799.898768:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994282496 00000100:00100000:1.0:1788832799.898808:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788832799.898816:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994282496:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788832799.899016:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832799.899081:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994282496:12345-0@lo:400:kworker.0 Request processed in 265us (4183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832799.899089:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788832799.899211:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994282880 00000100:00100000:2.0:1788832799.899216:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994282880 00000100:00100000:2.0:1788832799.899250:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788832799.899256:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994282880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832799.899304:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994282880:12345-0@lo:400:kworker.0 Request processed in 48us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832799.899310:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788832799.899325:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832799.899434:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994282752 00000100:00100000:0.0:1788832799.899438:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994282752 00000100:00100000:0.0:1788832799.899501:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994282624 00000100:00100000:0.0:1788832799.899504:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994282624 00000100:00100000:0.0:1788832799.899513:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994283008 00000100:00100000:0.0:1788832799.899515:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994283008 00000100:00100000:3.0:1788832799.899544:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788832799.899551:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994282752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832799.899588:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994282752:12345-0@lo:400:kworker.0 Request processed in 38us (4809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832799.899599:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788832799.899614:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788832799.899619:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994282624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832799.899642:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994282624:12345-0@lo:400:kworker.0 Request processed in 24us (4810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832799.899647:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788832799.899710:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994282624:0@lo:400:kworker.0 00000100:00100000:1.0:1788832799.899723:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994282752:0@lo:400:kworker.0 00010000:00080000:1.0:1788832799.899780:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b79e680 x1875726994282880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832799.899790:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994282880:0@lo:400:kworker.0 00000100:00100000:1.0:1788832799.899799:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994282496:0@lo:400:kworker.0 00000100:00080000:2.0:1788832799.905270:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832799.909664:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788832799.909678:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994283008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832799.909785:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994283008:12345-0@lo:400:kworker.0 Request processed in 110us (14832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832799.909792:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788832799.909927:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994283008:0@lo:400:kworker.0 00000001:02000400:0.0:1788832799.950109:0:9251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.110 00010000:00010000:3.0:1788832800.342025:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832801.365929:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832801.430013:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832801.430037:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994283136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832801.430113:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832801.430240:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994283136 00000100:00100000:0.0:1788832801.430248:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994283136 00000100:00100000:0.0:1788832801.430314:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788832801.430324:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994283136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832801.430385:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832801.430435:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994283136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832801.430442:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788832801.430481:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b716a00 x1875726994283136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832801.430498:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994283136:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788832801.430611:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832801.626427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832801.626478:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832801.626516:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975377664 00000100:00100000:1.0:1788832801.626525:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975377664 00000100:00080000:3.0:1788832801.626659:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832801.626818:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975377536 00000100:00100000:2.0:1788832801.626823:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975377536 00000100:00100000:2.0:1788832801.626863:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 199 00000100:00100000:2.0:1788832801.626872:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2359:x1875726975377536:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832801.626934:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2359:x1875726975377536:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 63us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832801.626942:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 199 00000100:00100000:1.0:1788832801.627146:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 46 00000100:00100000:1.0:1788832801.627167:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975377664:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832801.627211:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975377664:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 45us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832801.627217:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 46 00010000:00010000:1.0:1788832802.390041:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788832802.615579:0:9348:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.110 00010000:00010000:3.0:1788832803.417457:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832804.437904:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832805.015152:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994283264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832805.015214:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832805.015285:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994283264 00000100:00100000:0.0:1788832805.015292:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994283264 00000100:00100000:0.0:1788832805.015341:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788832805.015348:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994283264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832805.015389:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832805.015432:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994283264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832805.015439:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788832805.015459:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788832805.015487:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b716a00 x1875726994283264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832805.015504:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994283264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832805.016127:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994283648:0@lo:400:kworker.0 00000100:00100000:2.0:1788832805.016165:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832805.016185:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832805.016191:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994283776:0@lo:400:kworker.0 00000100:00100000:2.0:1788832805.016216:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832805.016364:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994283520:0@lo:400:kworker.0 00000100:00100000:3.0:1788832805.016392:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832805.016419:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788832805.016425:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994283392:0@lo:400:kworker.0 00000100:00100000:3.0:1788832805.016451:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832805.016479:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994283904:0@lo:400:kworker.0 00000100:00100000:3.0:1788832805.016499:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832805.016624:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994283648 00000100:00100000:0.0:1788832805.016630:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994283648 00000100:00100000:0.0:1788832805.016679:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994283520 00000100:00100000:0.0:1788832805.016683:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994283520 00000100:00100000:0.0:1788832805.016706:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994283904 00000100:00100000:0.0:1788832805.016709:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994283904 00000100:00100000:0.0:1788832805.016725:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788832805.016733:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994283648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832805.016868:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994283648:12345-0@lo:400:kworker.0 Request processed in 135us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832805.016875:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788832805.016892:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788832805.016898:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c0547b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994283520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832805.016930:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c0547b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994283520:12345-0@lo:400:kworker.0 Request processed in 33us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832805.016936:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788832805.016948:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788832805.016954:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994283904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832805.016981:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994283904:12345-0@lo:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832805.016986:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788832805.017003:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994283776 00000100:00100000:0.0:1788832805.017216:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994283776 00000100:00100000:0.0:1788832805.017251:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788832805.017257:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994283776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832805.017289:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994283776:12345-0@lo:400:kworker.0 Request processed in 32us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832805.017295:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788832805.017336:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994283904:0@lo:400:kworker.0 00000100:00100000:0.0:1788832805.017346:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994283520:0@lo:400:kworker.0 00010000:00080000:0.0:1788832805.017506:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a9bdc00 x1875726994283776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832805.017517:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994283776:0@lo:400:kworker.0 00000100:00100000:0.0:1788832805.017526:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994283648:0@lo:400:kworker.0 00000100:00080000:3.0:1788832805.017582:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832805.017585:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832805.017637:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994283392 00000100:00100000:1.0:1788832805.017641:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994283392 00000100:00100000:1.0:1788832805.017697:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788832805.017704:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994283392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832805.017770:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994283392:12345-0@lo:400:kworker.0 Request processed in 67us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832805.017776:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788832805.017852:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994283392:0@lo:400:kworker.0 00000001:02000400:0.0:1788832805.272715:0:9446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.110 00010000:00010000:1.0:1788832805.462243:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832806.486862:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832806.550873:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994284032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832806.550938:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832806.551202:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994284032 00000100:00100000:1.0:1788832806.551210:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994284032 00000100:00100000:1.0:1788832806.551260:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788832806.551268:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c0547b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994284032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832806.551298:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832806.551494:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c0547b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994284032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 226us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832806.551502:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788832806.551581:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b716a00 x1875726994284032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832806.551599:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994284032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832806.751345:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832806.751440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832806.751593:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975377792 00000100:00100000:2.0:1788832806.751603:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975377792 00000100:00100000:2.0:1788832806.751657:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 201 00000100:00100000:2.0:1788832806.751674:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2357:x1875726975377792:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832806.751764:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2357:x1875726975377792:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 69us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832806.751780:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 201 00000100:00100000:0.0:1788832806.752926:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975377920 00000100:00100000:0.0:1788832806.752933:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975377920 00000100:00100000:0.0:1788832806.752996:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 50 00000100:00100000:0.0:1788832806.753004:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2357:x1875726975377920:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832806.753059:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2357:x1875726975377920:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 55us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832806.753066:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 50 00000100:00080000:2.0:1788832806.753225:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788832807.114817:0:9494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 22:00:05 EDT 2026 00010000:00010000:3.0:1788832807.509890:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832808.534895:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832809.558862:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832810.133890:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832810.133912:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994284160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832810.133989:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832810.134229:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994284160 00000100:00100000:0.0:1788832810.134236:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994284160 00000100:00100000:0.0:1788832810.134284:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788832810.134292:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994284160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832810.134392:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832810.134438:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994284160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832810.134445:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788832810.135810:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b714a80 x1875726994284160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832810.135832:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994284160:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788832810.136005:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832810.137177:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994284288:0@lo:400:kworker.0 00000100:00100000:0.0:1788832810.137237:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832810.137405:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994284288 00000100:00100000:2.0:1788832810.137413:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994284288 00000100:00100000:2.0:1788832810.137454:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788832810.137462:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994284288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832810.137820:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c0547a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994284672:0@lo:400:kworker.0 00000100:00100000:3.0:1788832810.137851:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832810.137874:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832810.137880:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c05479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994284800:0@lo:400:kworker.0 00000100:00100000:3.0:1788832810.138030:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832810.138070:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c05479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994284416:0@lo:400:kworker.0 00000100:00100000:3.0:1788832810.138094:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832810.138114:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832810.138119:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c05478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994284544:0@lo:400:kworker.0 00000100:00100000:3.0:1788832810.138139:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832810.138167:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994284800 00000100:00100000:3.0:1788832810.138172:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994284800 00000100:00100000:3.0:1788832810.138213:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994284416 00000100:00100000:3.0:1788832810.138216:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994284416 00000100:00100000:3.0:1788832810.138228:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994284544 00000100:00100000:3.0:1788832810.138231:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994284544 00000100:00100000:3.0:1788832810.138246:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788832810.138253:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c0547b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994284800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832810.138291:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c0547b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994284800:12345-0@lo:400:kworker.0 Request processed in 38us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832810.138298:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788832810.138315:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788832810.138593:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994284416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832810.138631:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994284416:12345-0@lo:400:kworker.0 Request processed in 42us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832810.138638:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788832810.138653:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788832810.138659:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c0547a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994284544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832810.138685:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c0547a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994284544:12345-0@lo:400:kworker.0 Request processed in 26us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832810.138692:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788832810.138716:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832810.138830:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c05478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994284544:0@lo:400:kworker.0 00000100:00100000:3.0:1788832810.138846:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c05479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994284416:0@lo:400:kworker.0 00000100:00100000:3.0:1788832810.138874:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c05479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994284800:0@lo:400:kworker.0 00000100:00100000:0.0:1788832810.141643:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994284288:0@lo:400:kworker.0 00000100:00100000:2.0:1788832810.141729:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994284288:12345-0@lo:400:kworker.0 Request processed in 4265us (4488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832810.141853:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994284672 00000100:00100000:3.0:1788832810.141862:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994284672 00000100:00100000:3.0:1788832810.141920:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788832810.141930:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994284672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832810.142002:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994284672:12345-0@lo:400:kworker.0 Request processed in 74us (4150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832810.142009:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788832810.142045:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984c0547a300 x1875726994284672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832810.142058:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c0547a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994284672:0@lo:400:kworker.0 00000100:00080000:0.0:1788832810.142118:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832810.142571:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00010000:3.0:1788832810.584492:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832811.605913:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832811.670459:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994284928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832811.670524:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832811.670601:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994284928 00000100:00100000:0.0:1788832811.670608:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994284928 00000100:00100000:0.0:1788832811.670658:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788832811.670669:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994284928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832811.670700:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832811.670772:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994284928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832811.670779:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788832811.670909:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b716d80 x1875726994284928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832811.670927:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994284928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832811.869793:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832811.869865:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832811.869896:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975378048 00000100:00100000:1.0:1788832811.869905:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975378048 00000100:00100000:1.0:1788832811.869956:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 203 00000100:00100000:1.0:1788832811.869964:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2360:x1875726975378048:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832811.870025:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2360:x1875726975378048:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 61us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832811.870032:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 203 00000100:00100000:1.0:1788832811.870073:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975378176 00000100:00100000:1.0:1788832811.870077:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975378176 00000100:00100000:1.0:1788832811.870115:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 54 00000100:00100000:1.0:1788832811.870122:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975378176:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832811.870150:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975378176:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832811.870157:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 54 00000100:00080000:1.0:1788832811.870262:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788832812.631594:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832813.660653:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832814.682943:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832815.254336:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994285056:0@lo:400:kworker.0 00000100:00100000:0.0:1788832815.254408:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832815.254469:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994285568:0@lo:400:kworker.0 00000100:00100000:0.0:1788832815.254499:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832815.254543:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788832815.254550:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994285440:0@lo:400:kworker.0 00000100:00100000:0.0:1788832815.254589:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832815.254617:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994285312:0@lo:400:kworker.0 00000100:00100000:0.0:1788832815.254647:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832815.254677:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788832815.254684:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994285184:0@lo:400:kworker.0 00000100:00100000:0.0:1788832815.254705:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832815.254731:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994285696:0@lo:400:kworker.0 00000100:00100000:0.0:1788832815.254795:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832815.254828:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994285568 00000100:00100000:0.0:1788832815.254839:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994285568 00000100:00100000:0.0:1788832815.254898:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994285312 00000100:00100000:0.0:1788832815.254916:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994285312 00000100:00100000:0.0:1788832815.254942:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994285184 00000100:00100000:0.0:1788832815.254947:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994285184 00000100:00100000:0.0:1788832815.254971:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788832815.254984:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994285568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832815.255067:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994285568:12345-0@lo:400:kworker.0 Request processed in 84us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832815.255080:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788832815.255109:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788832815.255119:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994285312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832815.255321:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994285312:12345-0@lo:400:kworker.0 Request processed in 202us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832815.255328:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788832815.255348:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788832815.255355:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994285184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832815.255393:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994285184:12345-0@lo:400:kworker.0 Request processed in 38us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832815.255405:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788832815.255428:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994285440 00000100:00100000:0.0:1788832815.255434:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994285440 00000100:00100000:0.0:1788832815.255465:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994285696 00000100:00100000:0.0:1788832815.255468:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994285696 00000100:00100000:0.0:1788832815.255494:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788832815.255501:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994285440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832815.255548:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994285440:12345-0@lo:400:kworker.0 Request processed in 48us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832815.255554:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788832815.255581:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788832815.255589:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994285696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832815.255622:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994285696:12345-0@lo:400:kworker.0 Request processed in 35us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832815.255627:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788832815.255896:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832815.255903:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788832815.255906:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832815.256012:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832815.256029:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994285824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832815.256090:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832815.256237:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994285824 00000100:00100000:0.0:1788832815.256242:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994285824 00000100:00100000:0.0:1788832815.256290:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788832815.256298:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c0547a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994285824:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832815.256360:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994285056 00000100:00100000:2.0:1788832815.256365:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994285056 00000100:00100000:2.0:1788832815.256403:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788832815.256410:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994285056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832815.256459:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994285056:12345-0@lo:400:kworker.0 Request processed in 50us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832815.256466:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00002000:00000024:0.0:1788832815.256790:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832815.256878:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994285184:0@lo:400:kworker.0 00010000:00080000:2.0:1788832815.256898:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398f8380 x1875726994285696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832815.256910:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994285696:0@lo:400:kworker.0 00000100:00100000:2.0:1788832815.256924:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994285312:0@lo:400:kworker.0 00010000:00080000:2.0:1788832815.256974:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3bd57100 x1875726994285440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832815.256997:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994285440:0@lo:400:kworker.0 00000100:00100000:2.0:1788832815.257010:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994285056:0@lo:400:kworker.0 00000100:00100000:2.0:1788832815.257026:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994285568:0@lo:400:kworker.0 00000100:00100000:0.0:1788832815.257359:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c0547a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994285824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1060us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832815.257373:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788832815.257537:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b716d80 x1875726994285824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832815.257564:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994285824:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788832815.705009:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832816.728947:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832816.791394:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832816.791417:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994285952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832816.791625:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832816.791852:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994285952 00000100:00100000:3.0:1788832816.791860:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994285952 00000100:00100000:3.0:1788832816.792099:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788832816.792109:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994285952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832816.792144:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832816.792198:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994285952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832816.792204:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788832816.792394:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398f8380 x1875726994285952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832816.792413:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994285952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832816.989999:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832816.990052:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832816.990081:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975378304 00000100:00100000:0.0:1788832816.990089:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975378304 00000100:00100000:0.0:1788832816.990141:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 205 00000100:00100000:0.0:1788832816.990152:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2360:x1875726975378304:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832816.990225:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2360:x1875726975378304:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 75us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832816.990233:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 205 00000100:00100000:0.0:1788832816.990271:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975378432 00000100:00100000:0.0:1788832816.990275:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975378432 00000100:00100000:0.0:1788832816.990324:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 58 00000100:00100000:0.0:1788832816.990333:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975378432:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832816.990367:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975378432:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 36us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832816.990373:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 58 00000100:00080000:0.0:1788832816.990392:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788832817.755932:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832818.777593:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832819.799931:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832820.384923:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994286080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832820.384993:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832820.385074:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994286080 00000100:00100000:2.0:1788832820.385081:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994286080 00000100:00100000:2.0:1788832820.385127:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788832820.385134:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994286080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832820.385163:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832820.385199:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994286080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832820.385206:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788832820.385221:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788832820.385244:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398f8380 x1875726994286080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832820.385288:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994286080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832820.386915:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994286208:0@lo:400:kworker.0 00000100:00100000:2.0:1788832820.387066:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832820.392497:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832820.392518:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994286336:0@lo:400:kworker.0 00000100:00100000:2.0:1788832820.392848:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832820.392900:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994286208 00000100:00100000:2.0:1788832820.392907:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994286208 00000100:00100000:2.0:1788832820.393038:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788832820.393047:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994286208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832820.393100:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994286208:12345-0@lo:400:kworker.0 Request processed in 54us (6033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832820.393106:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788832820.393159:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994286208:0@lo:400:kworker.0 00000100:00100000:0.0:1788832820.393401:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994286464:0@lo:400:kworker.0 00000100:00100000:0.0:1788832820.393430:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832820.393450:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832820.393456:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994286592:0@lo:400:kworker.0 00000100:00100000:0.0:1788832820.393480:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832820.393503:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788832820.393511:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994286720:0@lo:400:kworker.0 00000100:00100000:0.0:1788832820.393533:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832820.393557:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994286336 00000100:00100000:0.0:1788832820.393785:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994286336 00000100:00100000:0.0:1788832820.393814:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994286464 00000100:00100000:0.0:1788832820.393817:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994286464 00000100:00100000:0.0:1788832820.393836:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994286720 00000100:00100000:0.0:1788832820.393838:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994286720 00000100:00100000:0.0:1788832820.393853:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788832820.393859:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994286336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832820.393894:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994286336:12345-0@lo:400:kworker.0 Request processed in 35us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832820.393900:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788832820.393914:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788832820.393920:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994286464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832820.394064:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994286464:12345-0@lo:400:kworker.0 Request processed in 143us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832820.394072:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788832820.394087:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788832820.394095:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994286720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832820.394134:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994286592 00000100:00100000:0.0:1788832820.394134:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994286720:12345-0@lo:400:kworker.0 Request processed in 40us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832820.394140:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994286592 00000100:00100000:0.0:1788832820.394145:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788832820.394180:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788832820.394189:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994286592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832820.394227:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994286592:12345-0@lo:400:kworker.0 Request processed in 40us (746us total) trans 0 rc 0/0 00010000:00080000:3.0:1788832820.394295:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b716a00 x1875726994286592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832820.394307:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994286592:0@lo:400:kworker.0 00000100:00100000:3.0:1788832820.394317:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994286464:0@lo:400:kworker.0 00000100:00100000:0.0:1788832820.394413:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994286720:0@lo:400:kworker.0 00000100:00100000:2.0:1788832820.394447:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994286336:0@lo:400:kworker.0 00000100:00080000:2.0:1788832820.394465:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832820.394469:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832820.394552:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1788832820.821905:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832821.845914:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832821.910147:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832821.910175:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994286848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832821.910251:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832821.910359:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994286848 00000100:00100000:2.0:1788832821.910367:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994286848 00000100:00100000:2.0:1788832821.910430:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788832821.910440:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994286848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832821.910473:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832821.910526:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994286848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832821.910548:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788832821.910893:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398f9500 x1875726994286848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832821.910912:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994286848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832822.106783:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832822.106830:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832822.106892:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975378688 00000100:00100000:1.0:1788832822.106902:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975378688 00000100:00100000:1.0:1788832822.106970:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 62 00000100:00100000:1.0:1788832822.106981:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975378688:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832822.107064:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975378688:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 84us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832822.107071:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 62 00000100:00080000:2.0:1788832822.107125:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832822.107175:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975378560 00000100:00100000:0.0:1788832822.107179:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975378560 00000100:00100000:0.0:1788832822.107210:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 207 00000100:00100000:0.0:1788832822.107217:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2360:x1875726975378560:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832822.107492:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2360:x1875726975378560:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 273us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832822.107499:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 207 00010000:00010000:1.0:1788832822.870041:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832823.894855:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788832824.648025:0:10124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:00:23 (1788832823) === 00010000:00010000:3.0:1788832824.923866:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832825.276082:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832825.276213:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975378816 00000100:00100000:0.0:1788832825.276224:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975378816 00000100:00100000:0.0:1788832825.276278:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 208 00000100:00100000:0.0:1788832825.276288:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:8160:x1875726975378816:12345-192.168.206.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788832825.276315:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832825.276335:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55348 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832825.276372:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55348 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832825.276399:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55348 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832825.276409:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d00030a00, rc 0) 00000100:00100000:0.0:1788832825.276468:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:8160:x1875726975378816:12345-192.168.206.41@tcp:101:mount.lustre.0 Request processed in 181us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832825.276484:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 208 00000100:00100000:1.0:1788832825.281723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832825.284560:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975378944 00000100:00100000:0.0:1788832825.284574:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975378944 00000100:00100000:0.0:1788832825.284644:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 209 00000100:00100000:0.0:1788832825.284654:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:8160:x1875726975378944:12345-192.168.206.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788832825.284967:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:8160:x1875726975378944:12345-192.168.206.41@tcp:501:mount.lustre.0 Request processed in 313us (3251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832825.284976:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 209 00000100:00100000:3.0:1788832825.291007:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832825.291210:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975379072 00000100:00100000:2.0:1788832825.291220:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975379072 00000100:00100000:2.0:1788832825.291275:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 210 00000100:00100000:2.0:1788832825.291286:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:8160:x1875726975379072:12345-192.168.206.41@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788832825.291776:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:8160:x1875726975379072:12345-192.168.206.41@tcp:503:mount.lustre.0 Request processed in 490us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832825.291785:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 210 00000100:00100000:2.0:1788832825.299095:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832825.299198:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975379200 00000100:00100000:0.0:1788832825.299207:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975379200 00000100:00100000:0.0:1788832825.299261:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 211 00000100:00100000:0.0:1788832825.299271:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:8164:x1875726975379200:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788832825.299717:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:8164:x1875726975379200:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 446us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832825.299726:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 211 00000100:00100000:1.0:1788832825.318690:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832825.318834:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975379328 00000100:00100000:2.0:1788832825.318843:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975379328 00000100:00100000:2.0:1788832825.318896:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 212 00000100:00100000:2.0:1788832825.318906:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:8164:x1875726975379328:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788832825.319170:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:8164:x1875726975379328:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 263us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832825.319185:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 212 00000100:00100000:3.0:1788832825.329167:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832825.329439:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975379456 00000100:00100000:0.0:1788832825.329449:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975379456 00000100:00100000:0.0:1788832825.329507:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 213 00000100:00100000:0.0:1788832825.329516:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:8160:x1875726975379456:12345-192.168.206.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788832825.329544:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832825.329560:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d00031c00/0xd270a10c1c6a4bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55372 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832825.329586:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d00031c00/0xd270a10c1c6a4bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55372 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832825.329598:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d00031c00/0xd270a10c1c6a4bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55372 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832825.329619:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d00031c00, rc 0) 00000100:00100000:0.0:1788832825.329676:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:8160:x1875726975379456:12345-192.168.206.41@tcp:101:mount.lustre.0 Request processed in 160us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832825.329683:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 213 00000100:00100000:1.0:1788832825.335808:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832825.336394:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975379584 00000100:00100000:0.0:1788832825.336405:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975379584 00000100:00100000:0.0:1788832825.337147:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 214 00000100:00100000:0.0:1788832825.337160:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:8160:x1875726975379584:12345-192.168.206.41@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788832825.337248:0:5848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788832825.337271:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788832825.337275:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788832825.337278:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788832825.337280:0:5848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788832825.343222:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:8160:x1875726975379584:12345-192.168.206.41@tcp:256:mount.lustre.0 Request processed in 6055us (7412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832825.343237:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 214 00000100:00100000:1.0:1788832825.348376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832825.348630:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975379712 00000100:00100000:2.0:1788832825.348640:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975379712 00000100:00100000:2.0:1788832825.348693:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 215 00000100:00100000:2.0:1788832825.348703:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:8160:x1875726975379712:12345-192.168.206.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788832825.348732:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832825.348781:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a4bb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55379 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832825.348809:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a4bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55379 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832825.348821:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a4bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55379 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832825.348829:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702000, rc 0) 00000100:00100000:2.0:1788832825.348918:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:8160:x1875726975379712:12345-192.168.206.41@tcp:101:mount.lustre.0 Request processed in 216us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832825.348926:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 215 00000100:00100000:1.0:1788832825.350633:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832825.351366:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975379840 00000100:00100000:0.0:1788832825.351388:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975379840 00000100:00100000:0.0:1788832825.351443:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 216 00000100:00100000:0.0:1788832825.351453:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:8160:x1875726975379840:12345-192.168.206.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788832825.354854:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:8160:x1875726975379840:12345-192.168.206.41@tcp:501:mount.lustre.0 Request processed in 3391us (4216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832825.354867:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 216 00000100:00100000:1.0:1788832825.357268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832825.357351:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975379968 00000100:00100000:3.0:1788832825.357360:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975379968 00000100:00100000:3.0:1788832825.357410:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 217 00000100:00100000:3.0:1788832825.357418:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:8160:x1875726975379968:12345-192.168.206.41@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788832825.357616:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:8160:x1875726975379968:12345-192.168.206.41@tcp:503:mount.lustre.0 Request processed in 197us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832825.357624:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 217 00000100:00100000:1.0:1788832825.360868:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832825.361105:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975380096 00000100:00100000:0.0:1788832825.361115:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975380096 00000100:00100000:0.0:1788832825.361160:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 218 00000100:00100000:0.0:1788832825.361169:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:8168:x1875726975380096:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788832825.361477:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:8168:x1875726975380096:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 307us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832825.361486:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 218 00000100:00100000:1.0:1788832825.364068:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832825.364155:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975380224 00000100:00100000:2.0:1788832825.364164:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975380224 00000100:00100000:2.0:1788832825.364213:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 219 00000100:00100000:2.0:1788832825.364222:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:8168:x1875726975380224:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788832825.364445:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:8168:x1875726975380224:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 223us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832825.364452:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 219 00000100:00100000:1.0:1788832825.381403:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832825.384112:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832825.393071:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975380352 00000100:00100000:0.0:1788832825.393085:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975380352 00000100:00100000:0.0:1788832825.393144:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975380736 00000100:00100000:0.0:1788832825.393147:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975380736 00000100:00100000:0.0:1788832825.393206:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 63 00000100:00100000:0.0:1788832825.393216:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2357:x1875726975380736:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832825.393306:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2357:x1875726975380736:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 91us (9201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832825.393314:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 63 00000100:00100000:0.0:1788832825.393332:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00100000:0.0:1788832825.393337:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2356:x1875726975380352:12345-192.168.206.41@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788832825.393360:0:5855:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 54fb0a9d-642f-4015-b9e9-160fa4c59dd6@192.168.206.41@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:0.0:1788832825.393411:0:5855:0:(genops.c:1385:class_connect()) connect: client 54fb0a9d-642f-4015-b9e9-160fa4c59dd6, cookie 0xd270a10c1c6a4bbf 00000004:00100000:0.0:1788832825.393441:0:5855:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788832825.393693:0:5855:0:(import.c:65:import_set_state_nolock()) ffff984c070de800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788832825.393724:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:2356:x1875726975380352:12345-192.168.206.41@tcp:38:mount.lustre.0 Request processed in 386us (12330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832825.393732:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00080000:1.0:1788832825.394077:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832825.414831:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832825.414884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832825.414971:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975380608 00000100:00100000:3.0:1788832825.414980:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975380608 00000100:00100000:3.0:1788832825.415056:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975380480 00000100:00100000:3.0:1788832825.415060:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975380480 00000100:00100000:3.0:1788832825.415086:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:3.0:1788832825.415095:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+7:8160:x1875726975380608:12345-192.168.206.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788832825.415135:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788832825.415222:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+7:8160:x1875726975380608:12345-192.168.206.41@tcp:41:mount.lustre.0 Request processed in 127us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832825.415247:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:3.0:1788832825.415277:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:3.0:1788832825.415284:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:0:x1875726975380480:12345-192.168.206.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788832825.415294:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788832825.415327:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:0:x1875726975380480:12345-192.168.206.41@tcp:41:mount.lustre.0 Request processed in 44us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832825.415333:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00080000:1.0:1788832825.415739:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832825.423561:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832825.423655:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975380864 00000100:00100000:3.0:1788832825.423664:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975380864 00000100:00100000:3.0:1788832825.423724:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00100000:3.0:1788832825.423913:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:8160:x1875726975380864:12345-192.168.206.41@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788832825.424009:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:8160:x1875726975380864:12345-192.168.206.41@tcp:40:mount.lustre.0 Request processed in 276us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832825.424017:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00100000:3.0:1788832825.427792:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832825.427825:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832825.427861:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832825.428141:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975381248 00000100:00100000:0.0:1788832825.428152:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975381248 00000100:00100000:0.0:1788832825.428215:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 1 00000100:00100000:0.0:1788832825.428224:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:8160:x1875726975381248:12345-192.168.206.41@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788832825.428297:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788832825.428369:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:8160:x1875726975381248:12345-192.168.206.41@tcp:33:mount.lustre.0 Request processed in 146us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832825.428377:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 1 00000100:00100000:2.0:1788832825.428700:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975380992 00000100:00100000:2.0:1788832825.428706:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975380992 00000100:00100000:2.0:1788832825.428764:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975381120 00000100:00100000:2.0:1788832825.428767:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975381120 00000100:00100000:2.0:1788832825.428786:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:2.0:1788832825.428791:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875726975380992:12345-192.168.206.41@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788832825.428829:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 54fb0a9d-642f-4015-b9e9-160fa4c59dd6@192.168.206.41@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:2.0:1788832825.428859:0:6698:0:(genops.c:1385:class_connect()) connect: client 54fb0a9d-642f-4015-b9e9-160fa4c59dd6, cookie 0xd270a10c1c6a4bc6 00002000:00100000:2.0:1788832825.428870:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 54fb0a9d-642f-4015-b9e9-160fa4c59dd6/ffff984c06637800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788832825.428894:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788832825.429128:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788832825.429155:0:6698:0:(import.c:65:import_set_state_nolock()) ffff984c06637000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832825.429190:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:2356:x1875726975380992:12345-192.168.206.41@tcp:8:mount.lustre.0 Request processed in 397us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832825.429198:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:2.0:1788832825.429214:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00100000:2.0:1788832825.429220:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875726975381120:12345-192.168.206.41@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788832825.429235:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 54fb0a9d-642f-4015-b9e9-160fa4c59dd6@192.168.206.41@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:2.0:1788832825.429250:0:6698:0:(genops.c:1385:class_connect()) connect: client 54fb0a9d-642f-4015-b9e9-160fa4c59dd6, cookie 0xd270a10c1c6a4bcd 00002000:00100000:2.0:1788832825.429255:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 54fb0a9d-642f-4015-b9e9-160fa4c59dd6/ffff984c06631800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788832825.429269:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788832825.430015:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788832825.430039:0:6698:0:(import.c:65:import_set_state_nolock()) ffff984c06635000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832825.430072:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:2356:x1875726975381120:12345-192.168.206.41@tcp:8:mount.lustre.0 Request processed in 850us (2209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832825.430080:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00100000:1.0:1788832825.494532:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994287360:0@lo:400:kworker.0 00000100:00100000:1.0:1788832825.494599:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832825.494658:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832825.494665:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994287232:0@lo:400:kworker.0 00000100:00100000:1.0:1788832825.494690:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832825.494718:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994287232 00000100:00100000:1.0:1788832825.494725:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994287232 00000100:00100000:1.0:1788832825.494812:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788832825.494821:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994287232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832825.494870:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994287232:12345-0@lo:400:kworker.0 Request processed in 51us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832825.494877:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788832825.494900:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832825.494925:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994287232:0@lo:400:kworker.0 00000100:00100000:0.0:1788832825.495008:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994287104:0@lo:400:kworker.0 00000100:00100000:0.0:1788832825.495040:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832825.495070:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994287616:0@lo:400:kworker.0 00000100:00100000:0.0:1788832825.495092:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832825.495116:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788832825.495128:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994286976:0@lo:400:kworker.0 00000100:00100000:0.0:1788832825.495154:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832825.495177:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994287488:0@lo:400:kworker.0 00000100:00100000:0.0:1788832825.495198:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832825.495223:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994286976 00000100:00100000:0.0:1788832825.495227:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994286976 00000100:00100000:0.0:1788832825.495275:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788832825.495282:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994286976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832825.495317:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994286976:12345-0@lo:400:kworker.0 Request processed in 35us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832825.495323:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788832825.495356:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994286976:0@lo:400:kworker.0 00000100:00100000:3.0:1788832825.495507:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994287104 00000100:00100000:3.0:1788832825.495512:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994287104 00000100:00100000:3.0:1788832825.495534:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994287488 00000100:00100000:3.0:1788832825.495537:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994287488 00000100:00100000:3.0:1788832825.495562:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788832825.495568:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994287104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832825.495608:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994287104:12345-0@lo:400:kworker.0 Request processed in 40us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832825.495625:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788832825.495639:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788832825.495645:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994287488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832825.495672:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994287488:12345-0@lo:400:kworker.0 Request processed in 28us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832825.495678:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788832825.495693:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832825.495710:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994287488:0@lo:400:kworker.0 00000100:00100000:3.0:1788832825.495720:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994287104:0@lo:400:kworker.0 00000100:00100000:1.0:1788832825.495805:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994287360 00000100:00100000:1.0:1788832825.495809:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994287360 00000100:00100000:1.0:1788832825.495849:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994287616 00000100:00100000:1.0:1788832825.495853:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994287616 00000100:00100000:1.0:1788832825.495875:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788832825.495881:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994287360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832825.495920:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994287360:12345-0@lo:400:kworker.0 Request processed in 39us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832825.495936:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788832825.495949:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788832825.495955:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994287616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832825.495999:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994287616:12345-0@lo:400:kworker.0 Request processed in 45us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832825.496006:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788832825.496043:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d39f2c000 x1875726994287360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832825.496054:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994287360:0@lo:400:kworker.0 00000100:00080000:3.0:1788832825.496106:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832825.496110:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788832825.496128:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b79d180 x1875726994287616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832825.496138:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994287616:0@lo:400:kworker.0 00000100:00100000:1.0:1788832825.496460:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832825.496471:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994287744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832825.496503:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832825.496679:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994287744 00000100:00100000:3.0:1788832825.496685:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994287744 00000100:00100000:3.0:1788832825.496720:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788832825.496727:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994287744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832825.496760:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832825.496808:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994287744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832825.496815:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788832825.496884:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984c0547bb80 x1875726994287744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832825.496898:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994287744:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788832825.942195:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788832826.089998:0:5875:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 54fb0a9d-642f-4015-b9e9-160fa4c59dd6 00000001:00100000:0.0:1788832826.128374:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 54fb0a9d-642f-4015-b9e9-160fa4c59dd6 00010000:00010000:3.0:1788832826.966896:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832827.029964:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832827.029995:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994287872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832827.030061:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832827.030137:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994287872 00000100:00100000:2.0:1788832827.030144:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994287872 00000100:00100000:2.0:1788832827.030196:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788832827.030205:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994287872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832827.030239:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832827.030285:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994287872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832827.030292:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788832827.030311:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788832827.030338:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3bd54700 x1875726994287872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832827.030356:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994287872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788832827.989879:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832829.013962:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788832829.156282:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 54fb0a9d-642f-4015-b9e9-160fa4c59dd6 00010000:00010000:3.0:1788832830.037991:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832830.614211:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994288000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832830.614278:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832830.614438:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994288000 00000100:00100000:2.0:1788832830.614446:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994288000 00000100:00100000:2.0:1788832830.614509:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788832830.614524:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994288000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832830.614556:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832830.614600:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994288000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832830.614607:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788832830.614687:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788832830.614929:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984c0547bb80 x1875726994288000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832830.614947:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994288000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832830.615380:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994288384:0@lo:400:kworker.0 00000100:00100000:2.0:1788832830.615415:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832830.615436:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832830.615442:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994288256:0@lo:400:kworker.0 00000100:00100000:2.0:1788832830.615464:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832830.615552:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994288384 00000100:00100000:3.0:1788832830.615557:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994288384 00000100:00100000:3.0:1788832830.615600:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994288256 00000100:00100000:3.0:1788832830.615603:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994288256 00000100:00100000:3.0:1788832830.615622:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788832830.615629:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994288384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832830.615692:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994288384:12345-0@lo:400:kworker.0 Request processed in 64us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832830.615699:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788832830.615714:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788832830.615721:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994288256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832830.615768:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994288256:12345-0@lo:400:kworker.0 Request processed in 47us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832830.615774:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788832830.615805:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994288256:0@lo:400:kworker.0 00000100:00100000:3.0:1788832830.615815:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994288384:0@lo:400:kworker.0 00000100:00100000:1.0:1788832830.616058:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994288128:0@lo:400:kworker.0 00000100:00100000:1.0:1788832830.616094:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832830.616133:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994288640:0@lo:400:kworker.0 00000100:00100000:1.0:1788832830.616157:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832830.616177:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832830.616182:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994288512:0@lo:400:kworker.0 00000100:00100000:1.0:1788832830.616205:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832830.616230:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994288640 00000100:00100000:1.0:1788832830.616234:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994288640 00000100:00100000:1.0:1788832830.616262:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788832830.616269:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994288640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832830.616311:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994288640:12345-0@lo:400:kworker.0 Request processed in 42us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832830.616318:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788832830.616336:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994288512 00000100:00100000:1.0:1788832830.616340:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994288512 00000100:00100000:1.0:1788832830.616366:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788832830.616373:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994288512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832830.616401:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994288512:12345-0@lo:400:kworker.0 Request processed in 29us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832830.616408:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788832830.616437:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3bd54380 x1875726994288512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832830.616448:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994288512:0@lo:400:kworker.0 00000100:00100000:1.0:1788832830.616459:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994288640:0@lo:400:kworker.0 00000100:00100000:3.0:1788832830.616534:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994288128 00000100:00100000:3.0:1788832830.616538:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994288128 00000100:00100000:3.0:1788832830.616571:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788832830.616578:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994288128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832830.616612:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994288128:12345-0@lo:400:kworker.0 Request processed in 34us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832830.616618:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788832830.616814:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994288128:0@lo:400:kworker.0 00000100:00080000:2.0:1788832830.616994:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832830.616998:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832830.817581:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832830.817625:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832830.817660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832830.817691:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832830.817726:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832830.817776:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975381632 00000100:00100000:1.0:1788832830.817790:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975381632 00000100:00100000:1.0:1788832830.817843:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975381504 00000100:00100000:1.0:1788832830.817847:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975381504 00000100:00100000:1.0:1788832830.817869:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 70 00000100:00100000:1.0:1788832830.817879:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2359:x1875726975381632:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832830.817968:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2359:x1875726975381632:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 79us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832830.817984:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 70 00000100:00100000:1.0:1788832830.818001:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 71 00000100:00100000:1.0:1788832830.818007:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975381504:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832830.818032:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975381504:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 25us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832830.818037:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 71 00000100:00100000:2.0:1788832830.818117:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975381376 00000100:00100000:2.0:1788832830.818121:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975381376 00000100:00100000:2.0:1788832830.818157:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 222 00000100:00100000:2.0:1788832830.818165:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975381376:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832830.818202:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975381376:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 38us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832830.818208:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 222 00000100:00100000:2.0:1788832830.818245:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975381888 00000100:00100000:2.0:1788832830.818249:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975381888 00000100:00100000:2.0:1788832830.818291:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975381760 00000100:00100000:2.0:1788832830.818295:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975381760 00000100:00100000:2.0:1788832830.818318:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 32 00000100:00100000:2.0:1788832830.818325:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2359:x1875726975381888:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832830.818351:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2359:x1875726975381888:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 27us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832830.818358:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 32 00000100:00100000:2.0:1788832830.818369:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 33 00000100:00100000:2.0:1788832830.818375:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2359:x1875726975381760:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832830.818397:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2359:x1875726975381760:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 22us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832830.818403:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 33 00000100:00080000:2.0:1788832830.818424:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832830.818428:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832830.818430:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788832831.061909:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832832.090722:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788832832.101992:0:10320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1788832832.151390:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994288768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832832.151457:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832832.154608:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994288768 00000100:00100000:2.0:1788832832.154621:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994288768 00000100:00100000:2.0:1788832832.154692:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788832832.154702:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994288768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832832.154736:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832832.154828:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994288768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (3371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832832.154835:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788832832.154879:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3ace7800 x1875726994288768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832832.154897:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994288768:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788832832.154978:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788832833.111364:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832834.141115:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832835.158918:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832835.735142:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994288896:0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.735271:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832835.735316:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994289408:0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.735340:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832835.735361:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788832835.735367:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994289280:0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.735387:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832835.735410:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994289024:0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.735430:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832835.735444:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994289536:0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.735462:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832835.735476:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832835.735480:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994289152:0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.735499:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832835.735527:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994288896 00000100:00100000:3.0:1788832835.735533:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994288896 00000100:00100000:3.0:1788832835.735569:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788832835.735576:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994288896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.735616:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994288896:12345-0@lo:400:kworker.0 Request processed in 40us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832835.735623:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788832835.735649:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994289408 00000100:00100000:3.0:1788832835.735652:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994289408 00000100:00100000:3.0:1788832835.735680:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994289024 00000100:00100000:3.0:1788832835.735682:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994289024 00000100:00100000:3.0:1788832835.735706:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994289152 00000100:00100000:3.0:1788832835.735708:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994289152 00000100:00100000:3.0:1788832835.735720:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788832835.735726:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994289408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.735780:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994289408:12345-0@lo:400:kworker.0 Request processed in 54us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832835.735786:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788832835.735797:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788832835.735803:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994289024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.735828:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994289024:12345-0@lo:400:kworker.0 Request processed in 26us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832835.735834:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788832835.735845:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788832835.736159:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994289152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.736192:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994289152:12345-0@lo:400:kworker.0 Request processed in 342us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832835.736262:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788832835.736282:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994289280 00000100:00100000:3.0:1788832835.736286:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994289280 00000100:00100000:3.0:1788832835.736317:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994289536 00000100:00100000:3.0:1788832835.736320:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994289536 00000100:00100000:3.0:1788832835.736339:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788832835.736345:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994289280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.736373:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994289280:12345-0@lo:400:kworker.0 Request processed in 29us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832835.736379:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788832835.736389:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788832835.736403:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994289536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.736431:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994289536:12345-0@lo:400:kworker.0 Request processed in 29us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832835.736436:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788832835.736479:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3bd57b80 x1875726994289280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832835.736492:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994289280:0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.736501:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994288896:0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.736509:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994289408:0@lo:400:kworker.0 00000100:00080000:3.0:1788832835.736533:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832835.736536:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832835.736538:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832835.736554:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994289152:0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.736564:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994289024:0@lo:400:kworker.0 00010000:00080000:3.0:1788832835.736573:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b715f80 x1875726994289536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832835.736582:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994289536:0@lo:400:kworker.0 00000100:00100000:3.0:1788832835.736631:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994289664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832835.736657:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832835.736685:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994289664 00000100:00100000:3.0:1788832835.736689:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994289664 00000100:00100000:3.0:1788832835.736711:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788832835.736717:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994289664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832835.736773:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832835.736805:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994289664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832835.736812:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788832835.736837:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3a573100 x1875726994289664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832835.737956:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994289664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832835.930330:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832835.930371:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832835.930405:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832835.930432:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832835.930461:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832835.930485:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975382400 00000100:00100000:3.0:1788832835.930495:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975382400 00000100:00100000:3.0:1788832835.930545:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975382528 00000100:00100000:3.0:1788832835.930548:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975382528 00000100:00100000:3.0:1788832835.930572:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 36 00000100:00100000:3.0:1788832835.930582:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2359:x1875726975382400:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832835.930650:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2359:x1875726975382400:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 69us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832835.930658:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 36 00000100:00100000:3.0:1788832835.930676:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 37 00000100:00100000:3.0:1788832835.930683:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975382528:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832835.930708:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975382528:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 25us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832835.930728:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 37 00000100:00080000:3.0:1788832835.930774:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832835.930777:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832835.930912:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975382016 00000100:00100000:1.0:1788832835.930916:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975382016 00000100:00100000:1.0:1788832835.930959:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 224 00000100:00100000:1.0:1788832835.930967:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2360:x1875726975382016:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832835.930994:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2360:x1875726975382016:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 29us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832835.931001:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 224 00000100:00100000:2.0:1788832835.931252:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975382144 00000100:00100000:2.0:1788832835.931256:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975382144 00000100:00100000:2.0:1788832835.931299:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975382272 00000100:00100000:2.0:1788832835.931303:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975382272 00000100:00100000:2.0:1788832835.931324:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 75 00000100:00100000:2.0:1788832835.931331:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975382144:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832835.931367:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975382144:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 36us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832835.931374:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 75 00000100:00100000:2.0:1788832835.931386:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 76 00000100:00100000:2.0:1788832835.931393:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975382272:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832835.931418:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975382272:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 25us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832835.931424:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 76 00000100:00080000:1.0:1788832835.931708:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788832836.182581:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832837.208559:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832837.274007:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994289792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832837.274079:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832837.286285:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994289792 00000100:00100000:3.0:1788832837.286297:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994289792 00000100:00100000:3.0:1788832837.286345:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788832837.286354:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994289792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832837.286385:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832837.286451:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994289792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (12372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832837.286458:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788832837.286584:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788832837.286617:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3ace7800 x1875726994289792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832837.286635:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994289792:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788832838.229904:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832839.254773:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832840.278853:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832840.853900:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832840.853931:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994289920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832840.853994:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832840.854071:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994289920 00000100:00100000:3.0:1788832840.854078:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994289920 00000100:00100000:3.0:1788832840.854131:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788832840.854139:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994289920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832840.854180:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832840.854224:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994289920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832840.854515:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788832840.854558:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788832840.854587:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984c0547bb80 x1875726994289920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832840.854610:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994289920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832840.855250:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994290432:0@lo:400:kworker.0 00000100:00100000:1.0:1788832840.855292:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832840.855316:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832840.855322:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994290304:0@lo:400:kworker.0 00000100:00100000:1.0:1788832840.855358:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832840.855397:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994290304 00000100:00100000:1.0:1788832840.855403:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994290304 00000100:00100000:2.0:1788832840.855697:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994290176:0@lo:400:kworker.0 00000100:00100000:2.0:1788832840.855729:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832840.855782:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994290048:0@lo:400:kworker.0 00000100:00100000:3.0:1788832840.855811:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832840.855852:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994290560:0@lo:400:kworker.0 00000100:00100000:3.0:1788832840.855880:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994290432 00000100:00100000:3.0:1788832840.855883:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994290432 00000100:00100000:3.0:1788832840.855925:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788832840.855934:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994290432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832840.855978:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994290432:12345-0@lo:400:kworker.0 Request processed in 46us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832840.855985:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788832840.856018:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994290048 00000100:00100000:3.0:1788832840.856022:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994290048 00000100:00100000:3.0:1788832840.856047:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788832840.856053:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994290048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832840.856086:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994290048:12345-0@lo:400:kworker.0 Request processed in 34us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832840.856092:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:3.0:1788832840.856119:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832840.856123:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788832840.856146:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3fada300 x1875726994290432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832840.856157:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994290432:0@lo:400:kworker.0 00000100:00100000:1.0:1788832840.860349:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994290176 00000100:00100000:1.0:1788832840.860362:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994290176 00000100:00100000:1.0:1788832840.860438:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788832840.860458:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994290304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832840.860545:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994290304:12345-0@lo:400:kworker.0 Request processed in 97us (5185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832840.860552:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788832840.860570:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788832840.860576:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994290176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832840.860610:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994290176:12345-0@lo:400:kworker.0 Request processed in 35us (4880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832840.860616:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788832840.860660:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994290176:0@lo:400:kworker.0 00000100:00100000:1.0:1788832840.860695:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994290304:0@lo:400:kworker.0 00000100:00100000:1.0:1788832840.860987:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832840.861026:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994290048:0@lo:400:kworker.0 00000100:00100000:1.0:1788832840.861046:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994290560 00000100:00100000:1.0:1788832840.861050:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994290560 00000100:00100000:1.0:1788832840.861079:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788832840.861086:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994290560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832840.861118:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994290560:12345-0@lo:400:kworker.0 Request processed in 33us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832840.861137:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788832840.861164:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994290560:0@lo:400:kworker.0 00000100:00080000:1.0:1788832840.866283:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832841.053062:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832841.053096:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832841.053125:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975382784 00000100:00100000:0.0:1788832841.053133:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975382784 00000100:00100000:0.0:1788832841.053191:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 80 00000100:00100000:0.0:1788832841.053202:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975382784:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832841.053298:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975382784:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 98us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832841.053305:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 80 00000100:00080000:0.0:1788832841.053328:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832841.053480:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975382656 00000100:00100000:3.0:1788832841.053485:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975382656 00000100:00100000:3.0:1788832841.053524:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 226 00000100:00100000:3.0:1788832841.053532:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975382656:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832841.053567:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975382656:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 36us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832841.053573:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 226 00000100:00100000:3.0:1788832841.058280:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832841.058314:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832841.058338:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832841.058362:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975383040 00000100:00100000:3.0:1788832841.058371:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975383040 00000100:00100000:3.0:1788832841.058436:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975383168 00000100:00100000:3.0:1788832841.058440:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975383168 00000100:00100000:3.0:1788832841.058465:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 39 00000100:00100000:3.0:1788832841.058476:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975383040:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832841.058539:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975383040:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 65us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832841.058547:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 39 00000100:00100000:3.0:1788832841.058563:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 40 00000100:00100000:3.0:1788832841.058570:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975383168:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832841.058595:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975383168:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 26us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832841.058602:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 40 00000100:00100000:3.0:1788832841.058619:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975382912 00000100:00100000:3.0:1788832841.058629:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975382912 00000100:00100000:3.0:1788832841.058669:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 81 00000100:00100000:3.0:1788832841.058677:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975382912:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832841.058706:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975382912:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 30us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832841.058713:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 81 00000100:00080000:3.0:1788832841.058892:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788832841.058901:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832841.058913:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788832841.309275:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832842.328036:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832842.391310:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994290688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832842.391368:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832842.391446:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994290688 00000100:00100000:2.0:1788832842.391453:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994290688 00000100:00100000:2.0:1788832842.391504:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788832842.391513:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994290688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832842.391550:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832842.391593:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994290688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832842.391600:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788832842.391617:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788832842.391642:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3ace4000 x1875726994290688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832842.391659:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994290688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788832843.351626:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832844.374936:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832845.397928:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832845.975260:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994290816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832845.975339:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832845.975449:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994290816 00000100:00100000:3.0:1788832845.975457:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994290816 00000100:00100000:3.0:1788832845.975521:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788832845.975530:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994290816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832845.975562:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832845.975605:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994290816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832845.975612:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788832845.975736:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788832845.975819:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984c0547bb80 x1875726994290816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832845.975836:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994290816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832845.976124:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875726994291200:0@lo:400:kworker.0 00000100:00100000:0.0:1788832845.976157:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832845.976178:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788832845.976184:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994291072:0@lo:400:kworker.0 00000100:00100000:0.0:1788832845.976207:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832845.976233:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994291200 00000100:00100000:0.0:1788832845.976237:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994291200 00000100:00100000:0.0:1788832845.976270:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994291072 00000100:00100000:0.0:1788832845.976273:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994291072 00000100:00100000:0.0:1788832845.976293:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788832845.976301:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875726994291200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832845.976337:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875726994291200:12345-0@lo:400:kworker.0 Request processed in 36us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832845.976343:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788832845.976356:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788832845.976371:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994291072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832845.976400:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994291072:12345-0@lo:400:kworker.0 Request processed in 31us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832845.976407:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788832845.976444:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832845.976462:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994291072:0@lo:400:kworker.0 00000100:00100000:0.0:1788832845.976472:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875726994291200:0@lo:400:kworker.0 00000100:00100000:3.0:1788832845.976572:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994291328:0@lo:400:kworker.0 00000100:00100000:3.0:1788832845.976602:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832845.976630:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788832845.976637:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994290944:0@lo:400:kworker.0 00000100:00100000:3.0:1788832845.976663:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832845.976690:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994291456:0@lo:400:kworker.0 00000100:00100000:3.0:1788832845.976724:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832845.976775:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994290944 00000100:00100000:3.0:1788832845.976779:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994290944 00000100:00100000:3.0:1788832845.976807:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788832845.976820:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994290944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832845.976850:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994290944:12345-0@lo:400:kworker.0 Request processed in 32us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832845.976857:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788832845.976908:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994290944:0@lo:400:kworker.0 00000100:00100000:0.0:1788832845.977019:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994291328 00000100:00100000:0.0:1788832845.977023:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994291328 00000100:00100000:0.0:1788832845.977064:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788832845.977070:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c0547bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994291328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832845.977108:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c0547bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994291328:12345-0@lo:400:kworker.0 Request processed in 38us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832845.977113:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788832845.977131:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994291456 00000100:00100000:0.0:1788832845.977134:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994291456 00000100:00100000:0.0:1788832845.977156:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788832845.977162:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994291456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832845.977186:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994291456:12345-0@lo:400:kworker.0 Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832845.977191:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788832845.977213:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994291456:0@lo:400:kworker.0 00010000:00080000:0.0:1788832845.977224:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b2b6d80 x1875726994291328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832845.977233:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994291328:0@lo:400:kworker.0 00000100:00080000:3.0:1788832845.977325:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788832845.977329:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832846.173875:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832846.173923:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832846.173930:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975383680 00000100:00100000:0.0:1788832846.173939:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975383680 00000100:00100000:3.0:1788832846.174152:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832846.174177:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832846.174390:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:0.0:1788832846.174402:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1817c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2356:x1875726975383680:12345-192.168.206.41@tcp:9:kworker.0 00000100:00100000:2.0:1788832846.174421:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975383296 00000100:00100000:2.0:1788832846.174427:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975383296 00000020:00000080:0.0:1788832846.174433:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4bc6 00000100:00080000:0.0:1788832846.174444:0:6700:0:(import.c:65:import_set_state_nolock()) ffff984c06637000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788832846.174463:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 228 00000100:00100000:2.0:1788832846.174472:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2360:x1875726975383296:12345-192.168.206.41@tcp:400:kworker.0 00000001:00000004:0.0:1788832846.174485:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788832846.174558:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2360:x1875726975383296:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 87us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832846.174580:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 228 00010000:00010000:2.0:1788832846.174619:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832846.174648:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975383552 00000100:00100000:2.0:1788832846.174653:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975383552 00000100:00100000:3.0:1788832846.174667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832846.174704:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975383424 00000100:00100000:2.0:1788832846.174709:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975383424 00000100:00080000:1.0:1788832846.174771:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832846.174776:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832846.174817:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 85 00000100:00100000:1.0:1788832846.174828:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975383552:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832846.174838:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 86 00000100:00100000:0.0:1788832846.174849:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975383424:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832846.174864:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975383552:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 38us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832846.174872:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 85 00000100:00100000:0.0:1788832846.174897:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975383424:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 50us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832846.174906:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 86 00000100:00100000:0.0:1788832846.174963:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975383808 00000100:00100000:0.0:1788832846.174968:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975383808 00000100:00100000:1.0:1788832846.174980:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1817c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+2:2356:x1875726975383680:12345-192.168.206.41@tcp:9:kworker.0 Request processed in 580us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832846.174989:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00080000:1.0:1788832846.175116:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832846.175156:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:0.0:1788832846.175166:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2356:x1875726975383808:12345-192.168.206.41@tcp:9:kworker.0 00000020:00000080:0.0:1788832846.175181:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4bcd 00000100:00080000:0.0:1788832846.175188:0:6698:0:(import.c:65:import_set_state_nolock()) ffff984c06635000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788832846.175270:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788832846.175453:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+2:2356:x1875726975383808:12345-192.168.206.41@tcp:9:kworker.0 Request processed in 288us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832846.175460:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 15 00010000:00010000:1.0:1788832846.175642:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832846.430249:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788832846.605736:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 54fb0a9d-642f-4015-b9e9-160fa4c59dd6 00000020:00000080:3.0:1788832846.605776:0:7651:0:(genops.c:885:class_export_put()) final put ffff984c06631800/54fb0a9d-642f-4015-b9e9-160fa4c59dd6 00000020:00000080:3.0:1788832846.605801:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984c06631800/54fb0a9d-642f-4015-b9e9-160fa4c59dd6 for lustre-OST0001 00000020:00000080:3.0:1788832846.605842:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984c06635000 for lustre-OST0001 00010000:00010000:2.0:1788832847.446062:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832847.511813:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994291584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832847.511896:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832847.512528:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994291584 00000100:00100000:3.0:1788832847.512536:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994291584 00000100:00100000:3.0:1788832847.512635:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788832847.512644:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994291584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832847.512676:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832847.512724:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994291584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832847.512731:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788832847.512783:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3ace4000 x1875726994291584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832847.512815:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994291584:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788832847.519691:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788832848.471655:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832849.493965:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788832849.672968:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 54fb0a9d-642f-4015-b9e9-160fa4c59dd6 00000020:00000080:2.0:1788832849.672978:0:6724:0:(genops.c:885:class_export_put()) final put ffff984c06637800/54fb0a9d-642f-4015-b9e9-160fa4c59dd6 00000020:00000080:0.0:1788832849.673170:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984c06637800/54fb0a9d-642f-4015-b9e9-160fa4c59dd6 for lustre-OST0000 00000020:00000080:0.0:1788832849.673225:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984c06637000 for lustre-OST0000 00000001:02000400:3.0:1788832850.458068:0:11028:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788832850.523633:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832851.094270:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994291712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832851.094341:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832851.094843:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994291712 00000100:00100000:2.0:1788832851.094862:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994291712 00000100:00100000:2.0:1788832851.094927:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788832851.094937:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994291712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832851.094971:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788832851.095059:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832851.096701:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994291840:0@lo:400:kworker.0 00000100:00100000:0.0:1788832851.096781:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832851.096846:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832851.096864:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994291968:0@lo:400:kworker.0 00000100:00100000:0.0:1788832851.096891:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832851.096921:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994291968 00000100:00100000:0.0:1788832851.096928:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994291968 00000100:00100000:0.0:1788832851.096968:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788832851.096977:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994291968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832851.097019:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994291968:12345-0@lo:400:kworker.0 Request processed in 43us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832851.097026:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788832851.097069:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994291968:0@lo:400:kworker.0 00000100:00100000:0.0:1788832851.097110:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994292096:0@lo:400:kworker.0 00000100:00100000:0.0:1788832851.097133:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832851.097157:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994292096 00000100:00100000:0.0:1788832851.097160:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994292096 00000100:00100000:0.0:1788832851.097188:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788832851.097195:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994292096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832851.097228:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994292096:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832851.097234:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788832851.097249:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832851.097265:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994292096:0@lo:400:kworker.0 00000100:00100000:0.0:1788832851.097304:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994291840 00000100:00100000:0.0:1788832851.097308:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994291840 00000100:00100000:0.0:1788832851.097343:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788832851.097349:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994291840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832851.097382:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994291840:12345-0@lo:400:kworker.0 Request processed in 33us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832851.097388:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788832851.097429:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994291840:0@lo:400:kworker.0 00000100:00100000:2.0:1788832851.105288:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994291712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10344us (10938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832851.105302:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788832851.105402:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b2b6d80 x1875726994291712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832851.105446:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994291712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832851.106356:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788832851.106371:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994292352:0@lo:400:kworker.0 00000100:00100000:0.0:1788832851.106426:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832851.106464:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832851.106472:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994292224:0@lo:400:kworker.0 00000100:00100000:0.0:1788832851.106498:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832851.106526:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994292224 00000100:00100000:0.0:1788832851.106532:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994292224 00000100:00100000:0.0:1788832851.106579:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788832851.106587:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994292224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832851.106634:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994292224:12345-0@lo:400:kworker.0 Request processed in 48us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832851.106641:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788832851.106673:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788832851.106696:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3ac84000 x1875726994292224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832851.106707:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994292224:0@lo:400:kworker.0 00000100:00100000:3.0:1788832851.106770:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994292352 00000100:00100000:3.0:1788832851.106775:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994292352 00000100:00100000:1.0:1788832851.106996:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788832851.107005:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994292352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832851.107045:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994292352:12345-0@lo:400:kworker.0 Request processed in 41us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832851.107051:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788832851.107078:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994292352:0@lo:400:kworker.0 00000100:00080000:0.0:1788832851.107935:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832851.293500:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832851.293685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832851.293787:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832851.295653:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975383936 00000100:00100000:0.0:1788832851.295665:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975383936 00000100:00100000:0.0:1788832851.295739:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 230 00000100:00100000:0.0:1788832851.295765:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2358:x1875726975383936:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832851.295849:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2358:x1875726975383936:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 86us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832851.295868:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 230 00000100:00100000:2.0:1788832851.300261:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975384192 00000100:00100000:2.0:1788832851.300275:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975384192 00000100:00080000:0.0:1788832851.300418:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832851.300610:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975384064 00000100:00100000:2.0:1788832851.300615:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975384064 00000100:00100000:2.0:1788832851.300711:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 90 00000100:00100000:2.0:1788832851.300722:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2358:x1875726975384192:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832851.300813:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2358:x1875726975384192:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 92us (7127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832851.300820:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 90 00000100:00100000:2.0:1788832851.300861:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 91 00000100:00100000:2.0:1788832851.300869:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975384064:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832851.300894:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975384064:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 26us (7109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832851.300900:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 91 00000100:00080000:3.0:1788832851.305274:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788832851.542632:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832852.566027:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832852.630063:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832852.630086:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994292480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832852.630161:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832852.630398:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994292480 00000100:00100000:1.0:1788832852.630406:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994292480 00000100:00100000:1.0:1788832852.630454:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788832852.630464:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994292480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832852.630496:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832852.630542:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994292480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832852.630550:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788832852.630585:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3ac87480 x1875726994292480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832852.630603:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994292480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788832853.589934:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788832854.293333:0:11175:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2c273580 20000000:00000080:0.0:1788832854.293351:0:11175:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984d3b7b0400 uarg=0000000000000000 20000000:01000000:0.0:1788832854.293384:0:11175:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788832854.293389:0:11175:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788832854.293393:0:11175:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788832854.294483:0:11176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788832854.295515:0:11175:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788832854.307977:0:11175:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788832854.308064:0:11175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.308086:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d00030600/0xd270a10c1c6a4b79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55341 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.308096:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d00030200/0xd270a10c1c6a4b87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b80 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.308103:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d00031e00/0xd270a10c1c6a4b95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b8e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.308110:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d05f05000/0xd270a10c1c6a4ba3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4b9c expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.308115:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a4bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55379 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.308148:0:11175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.308188:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a4bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55379 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.308201:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a4bb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55379 expref: 12 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832854.308214:0:11175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1875726994292608:192.168.206.41@tcp:104: 00010000:00010000:0.0:1788832854.308328:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d05f05000/0xd270a10c1c6a4ba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4b9c expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.308337:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d05f05000/0xd270a10c1c6a4ba3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4b9c expref: 18 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832854.308346:0:11175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1875726994292736:0@lo:104: 00000100:00100000:0.0:1788832854.308384:0:11175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832854.308427:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d00031e00/0xd270a10c1c6a4b95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4b8e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.309258:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d00031e00/0xd270a10c1c6a4b95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4b8e expref: 18 pid: 5847 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832854.309269:0:11175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1875726994292864:0@lo:104: 00000100:00100000:0.0:1788832854.309314:0:11175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832854.309340:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d00030200/0xd270a10c1c6a4b87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4b80 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.309361:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff984d00030200/0xd270a10c1c6a4b87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4b80 expref: 18 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832854.309369:0:11175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1875726994292992:0@lo:104: 00000100:00100000:0.0:1788832854.309392:0:11175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832854.309410:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d00030600/0xd270a10c1c6a4b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55341 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.309418:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d00030600/0xd270a10c1c6a4b79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55341 expref: 12 pid: 5848 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832854.309427:0:11175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1875726994293120:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832854.309577:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994292736 00000100:00100000:2.0:1788832854.309585:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994292736 00000100:00100000:2.0:1788832854.309636:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994292864 00000100:00100000:2.0:1788832854.309640:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994292864 00000100:00100000:2.0:1788832854.309650:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994292992 00000100:00100000:2.0:1788832854.309652:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994292992 00000100:00100000:2.0:1788832854.309665:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788832854.309673:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+5:11175:x1875726994292736:12345-0@lo:104: 00010000:00010000:2.0:1788832854.309684:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4ba3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.309766:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832854.309772:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+5:11175:x1875726994292736:12345-0@lo:104: Request processed in 100us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832854.309779:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788832854.309797:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788832854.309802:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+4:11175:x1875726994292864:12345-0@lo:104: 00010000:00010000:2.0:1788832854.309809:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4b95 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.309850:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788832854.309856:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+4:11175:x1875726994292864:12345-0@lo:104: Request processed in 54us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832854.309868:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788832854.309880:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832854.309886:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:11175:x1875726994292992:12345-0@lo:104: 00010000:00010000:2.0:1788832854.309893:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4b87 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832854.309907:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788832854.309914:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4ba3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832854.309921:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d00030e00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1788832854.309925:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4ba3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.309925:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788832854.309929:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd32c45e-9a6a-4349-b87e-107522b34816+3:11175:x1875726994292992:12345-0@lo:104: Request processed in 44us (537us total) trans 0 rc 0/0 00010000:00010000:3.0:1788832854.309934:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4ba3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832854.309935:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 10000000:00010000:3.0:1788832854.309941:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4ba3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832854.309947:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788832854.309948:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832854.309952:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4b95 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.309957:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788832854.309960:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4b95 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.309966:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4b95 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832854.309972:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4b95 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832854.309976:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788832854.309977:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4ba3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832854.309983:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832854.309987:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4b95 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.309992:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832854.310000:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4ba3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.310003:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4b95 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832854.310007:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d00030e00/0xd270a10c1c6a4b9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4ba3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.310009:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d05f05400/0xd270a10c1c6a4b8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4b95 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832854.310021:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832854.310021:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832854.310023:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832854.310024:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4b87 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.310024:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832854.310030:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1788832854.310032:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4b87 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832854.310038:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4b87 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832854.310044:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4b87 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.310047:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788832854.310049:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788832854.310061:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994293248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788832854.310063:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4b87 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832854.310068:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832854.310078:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4b87 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832854.310089:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832854.310094:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d3ada3400/0xd270a10c1c6a4b80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4b87 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832854.310120:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832854.310121:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788832854.310122:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832854.310124:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832854.310126:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994293376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832854.310270:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832854.310306:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994293248 00000100:00100000:2.0:1788832854.310310:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994293248 00010000:00010000:2.0:1788832854.310328:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d05f05000/0xd270a10c1c6a4ba3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4b9c expref: 19 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832854.310348:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994293376 00000100:00100000:2.0:1788832854.310356:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994293376 00010000:00010000:2.0:1788832854.310366:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d00031e00/0xd270a10c1c6a4b95 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4b8e expref: 20 pid: 5847 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832854.310381:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788832854.310387:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d08a80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32c45e-9a6a-4349-b87e-107522b34816+20:3314:x1875726994293248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832854.310396:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832854.310400:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d05f05000/0xd270a10c1c6a4ba3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4b9c expref: 20 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.310418:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d05f05000/0xd270a10c1c6a4ba3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4b9c expref: 20 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.310697:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832854.310731:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d08a80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32c45e-9a6a-4349-b87e-107522b34816+20:3314:x1875726994293248:12345-0@lo:103:ldlm_bl.0 Request processed in 344us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832854.310738:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788832854.310797:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788832854.310804:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994293376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832854.310811:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832854.310815:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d00031e00/0xd270a10c1c6a4b95 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4b8e expref: 19 pid: 5847 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.310823:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d00031e00/0xd270a10c1c6a4b95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4b8e expref: 19 pid: 5847 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.310834:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832854.310867:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994293376:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832854.310873:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788832854.310912:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994293376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832854.310921:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994293248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832854.311034:0:11175:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06de3900 going to sleep for 11 seconds 00010000:00010000:0.0:1788832854.311049:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d05f05000/0xd270a10c1c6a4ba3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4b9c expref: 18 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832854.311061:0:11175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1875726994292736:0@lo:104: 00010000:00010000:0.0:1788832854.311071:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d00031e00/0xd270a10c1c6a4b95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4b8e expref: 17 pid: 5847 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832854.311079:0:11175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1875726994292864:0@lo:104: 00000100:00100000:0.0:1788832854.311088:0:11175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1875726994292992:0@lo:104: 00000100:00100000:1.0:1788832854.311468:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994293504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832854.311500:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832854.311544:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994293504 00000100:00100000:1.0:1788832854.311556:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994293504 00010000:00010000:1.0:1788832854.311579:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d00030200/0xd270a10c1c6a4b87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4b80 expref: 17 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832854.311616:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788832854.311623:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32c45e-9a6a-4349-b87e-107522b34816+17:3316:x1875726994293504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788832854.311631:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832854.311635:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff984d00030200/0xd270a10c1c6a4b87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4b80 expref: 17 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.311643:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d00030200/0xd270a10c1c6a4b87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4b80 expref: 17 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.311654:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d00030200/0xd270a10c1c6a4b87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4b80 expref: 17 pid: 5846 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.311663:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832854.311692:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32c45e-9a6a-4349-b87e-107522b34816+16:3316:x1875726994293504:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832854.311698:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788832854.311726:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994293504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832854.322180:0:11175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1875726994292608:192.168.206.41@tcp:104: 00000100:00100000:0.0:1788832854.322196:0:11175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1875726994293120:192.168.206.41@tcp:104: 00010000:00010000:0.0:1788832854.322246:0:11175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832854.322808:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832854.322897:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832854.322942:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975384320 00000100:00100000:1.0:1788832854.322949:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975384320 00000100:00100000:0.0:1788832854.322971:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975384448 00000100:00100000:0.0:1788832854.322975:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975384448 00010000:00010000:1.0:1788832854.322981:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a4bb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55379 expref: 14 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.322988:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d00030600/0xd270a10c1c6a4b79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55341 expref: 14 pid: 5848 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832854.323054:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 28 00000100:00100000:1.0:1788832854.323063:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+14:2357:x1875726975384320:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832854.323079:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832854.323092:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a4bb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55379 expref: 14 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323102:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a4bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55379 expref: 14 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323118:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a4bb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55379 expref: 14 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323132:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832854.323186:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2357:x1875726975384320:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 123us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832854.323193:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 28 00000100:00100000:1.0:1788832854.323210:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 29 00000100:00100000:1.0:1788832854.323216:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:2357:x1875726975384448:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832854.323223:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832854.323228:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff984d00030600/0xd270a10c1c6a4b79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55341 expref: 12 pid: 5848 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323237:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d00030600/0xd270a10c1c6a4b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55341 expref: 12 pid: 5848 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323247:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d00030600/0xd270a10c1c6a4b79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55341 expref: 12 pid: 5848 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323257:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323264:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323283:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323290:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323296:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323302:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323308:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d013d1800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788832854.323311:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323318:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323333:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832854.323343:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832854.323362:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:2357:x1875726975384448:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 147us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832854.323368:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 29 00010000:00010000:0.0:1788832854.326367:0:11175:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.326385:0:11175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832854.326393:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4bd4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832854.616008:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832855.579103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832855.579196:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975384576 00000100:00100000:0.0:1788832855.579205:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975384576 00000100:00100000:0.0:1788832855.579259:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 231 00000100:00100000:0.0:1788832855.579269:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:5598:x1875726975384576:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832855.579284:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832855.579303:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a4bdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553a3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832855.579330:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a4bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553a3 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832855.579341:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a4bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553a3 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832855.579350:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d013d0a00, rc 0) 00000100:00100000:0.0:1788832855.579688:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:5598:x1875726975384576:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 Request processed in 419us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832855.579696:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 231 00000100:00100000:3.0:1788832855.583959:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832855.584030:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975384704 00000100:00100000:0.0:1788832855.584039:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975384704 00000100:00100000:0.0:1788832855.584086:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 232 00000100:00100000:0.0:1788832855.584095:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:5598:x1875726975384704:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832855.586678:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:5598:x1875726975384704:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 Request processed in 2575us (2717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832855.586691:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 232 00000100:00100000:1.0:1788832855.591166:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832855.595182:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975384832 00000100:00100000:0.0:1788832855.595195:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975384832 00000100:00100000:0.0:1788832855.596260:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 233 00000100:00100000:0.0:1788832855.596272:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:5598:x1875726975384832:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832855.596468:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:5598:x1875726975384832:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 Request processed in 198us (5310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832855.596476:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 233 00000100:00100000:2.0:1788832855.603086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832855.603204:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975384960 00000100:00100000:0.0:1788832855.603215:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975384960 00000100:00100000:0.0:1788832855.603273:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 234 00000100:00100000:0.0:1788832855.603292:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:5598:x1875726975384960:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832855.603468:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832855.603489:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4be2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553aa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832855.603514:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553aa expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832855.603538:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553aa expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832855.603546:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d013d1800, rc 0) 00000100:00100000:0.0:1788832855.603636:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:5598:x1875726975384960:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 Request processed in 354us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832855.603643:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 234 00000100:00100000:3.0:1788832855.608215:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832855.608487:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975385088 00000100:00100000:0.0:1788832855.608496:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975385088 00000100:00100000:0.0:1788832855.608613:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 235 00000100:00100000:0.0:1788832855.608623:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:5598:x1875726975385088:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832855.609083:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:5598:x1875726975385088:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 Request processed in 461us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832855.609091:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 235 00000100:00100000:1.0:1788832855.611224:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832855.611437:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975385216 00000100:00100000:0.0:1788832855.611447:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975385216 00000100:00100000:0.0:1788832855.611697:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 236 00000100:00100000:0.0:1788832855.611705:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:5598:x1875726975385216:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832855.612047:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:5598:x1875726975385216:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 Request processed in 341us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832855.612054:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 236 00010000:00010000:2.0:1788832855.638199:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788832855.639710:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788832855.639715:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d07487000 from 7 10000000:01000000:0.0:1788832855.639720:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788832855.639775:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832855.639792:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832855.639804:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832855.639828:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994293632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788832855.639896:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832855.639946:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06de36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832855.640086:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994293632 00000100:00100000:2.0:1788832855.640693:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994293632 00000100:00100000:2.0:1788832855.640844:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788832855.640856:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994293632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832855.640870:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832855.640884:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b703400/0xd270a10c1c6a4bf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4be9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832855.640908:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b703400/0xd270a10c1c6a4bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4be9 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832855.640919:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b703400/0xd270a10c1c6a4bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4be9 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832855.640929:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703400, rc 0) 00000100:00100000:2.0:1788832855.640987:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994293632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832855.640994:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788832855.641133:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994293632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832855.641148:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4bf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832855.641158:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4bf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832855.641212:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994293760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832855.641239:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832855.641275:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06de36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832855.642155:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994293760 00000100:00100000:2.0:1788832855.642164:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994293760 00000100:00100000:2.0:1788832855.642207:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788832855.642216:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994293760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832855.643095:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994293760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832855.643145:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994293888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832855.643188:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832855.643210:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06de36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832855.643225:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994293888 00000100:00100000:0.0:1788832855.643229:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994293888 00000100:00100000:0.0:1788832855.643264:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788832855.643270:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994293888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832855.643404:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994293888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832855.643411:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788832855.643448:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994293888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832855.643963:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994293760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1745us (2720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832855.643972:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000040:00080000:0.0:1788832855.644081:0:11200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788832855.644240:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788832855.644268:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788832855.644337:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4bf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832855.644354:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4bf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832855.644364:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788832855.644367:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d39f1a000 from 7 10000000:01000000:2.0:1788832855.644369:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788832855.644394:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832855.644402:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832855.644411:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832855.644427:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994294016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832855.644466:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832855.644495:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06954f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832855.644544:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994294016 00000100:00100000:3.0:1788832855.644550:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994294016 00000100:00100000:3.0:1788832855.644614:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788832855.644623:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994294016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832855.644633:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832855.644644:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3ada3400/0xd270a10c1c6a4bfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4bf7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832855.644675:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3ada3400/0xd270a10c1c6a4bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4bf7 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832855.644686:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3ada3400/0xd270a10c1c6a4bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4bf7 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832855.644694:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3400, rc 0) 00000100:00100000:3.0:1788832855.644731:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994294016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832855.644738:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788832855.645016:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994294016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832855.645030:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4bfe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832855.645040:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4bfe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832855.645086:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994294144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832855.645112:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832855.645188:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06954f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832855.645217:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994294144 00000100:00100000:3.0:1788832855.645221:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994294144 00000100:00100000:3.0:1788832855.645249:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788832855.645256:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994294144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832855.645469:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994294144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832855.645476:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788832855.645540:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994294144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832855.645569:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994294272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832855.645605:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832855.645625:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06954f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832855.645776:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994294272 00000100:00100000:3.0:1788832855.645781:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994294272 00000100:00100000:3.0:1788832855.645803:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788832855.645808:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994294272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832855.645934:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994294272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832855.645940:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788832855.646017:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994294272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788832855.646863:0:11201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788832855.646998:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788832855.647015:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788832855.647024:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4bfe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832855.647034:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4bfe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832855.647043:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788832855.647046:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d2a26c800 from 7 10000000:01000000:3.0:1788832855.647048:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788832855.647072:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832855.647080:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832855.647097:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832855.647114:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994294400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788832855.647152:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832855.647177:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d05e7c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788832855.647292:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994294400 00000100:00100000:2.0:1788832855.647299:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994294400 00000100:00100000:2.0:1788832855.647340:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788832855.647349:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994294400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832855.647359:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832855.647371:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b703a00/0xd270a10c1c6a4c0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4c05 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832855.647391:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b703a00/0xd270a10c1c6a4c0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4c05 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832855.647401:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b703a00/0xd270a10c1c6a4c0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4c05 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832855.647410:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703a00, rc 0) 00000100:00100000:2.0:1788832855.647448:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994294400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832855.647455:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788832855.647493:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994294400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832855.647506:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4c0c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832855.647522:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4c0c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832855.647566:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994294528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832855.647592:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832855.647604:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d07046cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832855.647615:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994294528 00000100:00100000:2.0:1788832855.647618:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994294528 00000100:00100000:2.0:1788832855.647635:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788832855.647641:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994294528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832855.648147:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994294528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 506us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832855.648155:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788832855.648213:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994294528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832855.648242:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994294656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832855.648288:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832855.648310:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d05e7c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832855.648387:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994294656 00000100:00100000:2.0:1788832855.648392:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994294656 00000100:00100000:2.0:1788832855.648422:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788832855.648430:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994294656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832855.648576:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994294656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832855.648584:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788832855.648620:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994294656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788832855.650494:0:11202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788832855.650722:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788832855.650767:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832855.650778:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4c0c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832855.650789:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4c0c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832856.214452:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832856.214474:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994294784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832856.214539:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832856.214616:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994294784 00000100:00100000:3.0:1788832856.214623:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994294784 00000100:00100000:3.0:1788832856.214675:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788832856.214685:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994294784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832856.214720:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832856.215544:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875726994295040:0@lo:400:kworker.0 00000100:00100000:1.0:1788832856.215598:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832856.215623:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832856.215629:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994294912:0@lo:400:kworker.0 00000100:00100000:1.0:1788832856.215651:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788832856.215698:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788832856.216390:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994295296:0@lo:400:kworker.0 00000100:00100000:2.0:1788832856.216425:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832856.216463:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832856.216470:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994295168:0@lo:400:kworker.0 00000100:00100000:2.0:1788832856.216496:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832856.216529:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994295040 00000100:00100000:2.0:1788832856.216535:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994295040 00000100:00100000:2.0:1788832856.216576:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994294912 00000100:00100000:2.0:1788832856.216580:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994294912 00000100:00100000:2.0:1788832856.216592:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994295296 00000100:00100000:2.0:1788832856.216594:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994295296 00000100:00100000:2.0:1788832856.216608:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788832856.216615:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875726994295040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832856.216663:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875726994295040:12345-0@lo:400:kworker.0 Request processed in 48us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832856.216669:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788832856.216685:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788832856.216692:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994294912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832856.216720:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994294912:12345-0@lo:400:kworker.0 Request processed in 29us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832856.216725:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788832856.216736:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788832856.216775:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994295296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832856.216808:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994295296:12345-0@lo:400:kworker.0 Request processed in 66us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832856.216814:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788832856.216847:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994295168 00000100:00100000:2.0:1788832856.216851:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994295168 00000100:00100000:3.0:1788832856.216988:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994294784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2303us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832856.216995:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788832856.217034:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3fad9880 x1875726994294784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832856.217054:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994294784:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788832856.217115:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832856.217119:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832856.220107:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994294912:0@lo:400:kworker.0 00000100:00100000:3.0:1788832856.220151:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875726994295040:0@lo:400:kworker.0 00000100:00100000:3.0:1788832856.220218:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994295296:0@lo:400:kworker.0 00000100:00100000:2.0:1788832856.220291:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788832856.220312:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994295168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832856.220410:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994295168:12345-0@lo:400:kworker.0 Request processed in 107us (3912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832856.220418:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788832856.222013:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3fad9500 x1875726994295168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832856.222029:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994295168:0@lo:400:kworker.0 00000100:00100000:2.0:1788832856.412293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832856.412343:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832856.412422:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975385472 00000100:00100000:0.0:1788832856.412431:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975385472 00000100:00100000:0.0:1788832856.412507:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 95 00000100:00100000:0.0:1788832856.412517:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975385472:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832856.412880:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832856.412906:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975385600 00000100:00100000:2.0:1788832856.412911:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975385600 00000100:00100000:2.0:1788832856.412945:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 96 00000100:00100000:2.0:1788832856.412955:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975385600:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832856.413010:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975385600:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 57us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832856.413018:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 96 00000100:00080000:3.0:1788832856.413078:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832856.413193:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975385472:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 676us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832856.413202:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 95 00000100:00100000:1.0:1788832856.413682:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975385344 00000100:00100000:1.0:1788832856.413688:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975385344 00000100:00100000:1.0:1788832856.413720:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 246 00000100:00100000:1.0:1788832856.413727:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2360:x1875726975385344:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832856.413792:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2360:x1875726975385344:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 65us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832856.413809:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 246 00010000:00010000:3.0:1788832856.661915:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832857.686390:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832857.750170:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788832857.750193:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994295424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832857.750257:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832857.750690:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994295424 00000100:00100000:1.0:1788832857.750698:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994295424 00000100:00100000:1.0:1788832857.750766:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788832857.750775:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994295424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832857.750808:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832857.750865:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994295424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832857.750872:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788832857.751210:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3fadad80 x1875726994295424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832857.751250:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994295424:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788832857.852014:0:11373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788832858.710144:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832859.734153:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832860.767624:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788832861.168464:0:11472:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:01:00 (1788832860) === 00000100:00100000:1.0:1788832861.334906:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994295552:0@lo:400:kworker.0 00000100:00100000:1.0:1788832861.334970:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832861.335016:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994296064:0@lo:400:kworker.0 00000100:00100000:1.0:1788832861.335052:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832861.335089:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832861.335096:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994295936:0@lo:400:kworker.0 00000100:00100000:1.0:1788832861.335121:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832861.335155:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994295552 00000100:00100000:1.0:1788832861.335162:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994295552 00000100:00100000:1.0:1788832861.335203:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788832861.335213:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994295552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832861.335263:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994295552:12345-0@lo:400:kworker.0 Request processed in 51us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832861.335270:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788832861.335303:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994296064 00000100:00100000:1.0:1788832861.335307:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994296064 00000100:00100000:1.0:1788832861.335343:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788832861.335349:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994296064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832861.335380:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994296064:12345-0@lo:400:kworker.0 Request processed in 32us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832861.335386:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788832861.335403:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994295936 00000100:00100000:1.0:1788832861.335406:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994295936 00000100:00100000:1.0:1788832861.335432:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788832861.335439:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994295936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832861.335467:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994295936:12345-0@lo:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832861.335473:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788832861.335504:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3fadb800 x1875726994295936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832861.335530:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994295936:0@lo:400:kworker.0 00000100:00100000:1.0:1788832861.335542:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994295552:0@lo:400:kworker.0 00000100:00100000:1.0:1788832861.335552:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994296064:0@lo:400:kworker.0 00000100:00100000:3.0:1788832861.336455:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994295680:0@lo:400:kworker.0 00000100:00100000:3.0:1788832861.336493:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832861.336519:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994296192:0@lo:400:kworker.0 00000100:00100000:3.0:1788832861.336541:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832861.336563:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832861.336570:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994295808:0@lo:400:kworker.0 00000100:00100000:3.0:1788832861.336590:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788832861.336623:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832861.336628:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832861.336637:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994295680 00000100:00100000:3.0:1788832861.336642:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994295680 00000100:00100000:3.0:1788832861.336688:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994295808 00000100:00100000:3.0:1788832861.336691:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994295808 00000100:00100000:3.0:1788832861.336717:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788832861.336723:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994295680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832861.336794:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994295680:12345-0@lo:400:kworker.0 Request processed in 70us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832861.336811:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788832861.336827:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788832861.336834:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994295808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832861.336862:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994295808:12345-0@lo:400:kworker.0 Request processed in 29us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832861.336868:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788832861.336886:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994296192 00000100:00100000:3.0:1788832861.336889:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994296192 00000100:00100000:3.0:1788832861.336915:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788832861.336921:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994296192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832861.336950:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994296192:12345-0@lo:400:kworker.0 Request processed in 30us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832861.336956:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788832861.336974:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832861.336977:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832861.336999:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994295808:0@lo:400:kworker.0 00000100:00100000:3.0:1788832861.337006:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994295680:0@lo:400:kworker.0 00010000:00080000:3.0:1788832861.337016:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3fad9500 x1875726994296192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832861.337025:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994296192:0@lo:400:kworker.0 00000100:00100000:3.0:1788832861.342889:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994296320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832861.342960:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832861.343096:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994296320 00000100:00100000:1.0:1788832861.343104:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994296320 00000100:00100000:1.0:1788832861.343157:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788832861.343165:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994296320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832861.343201:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832861.343248:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994296320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832861.343255:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788832861.343384:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3fadad80 x1875726994296320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832861.343403:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994296320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832861.384993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832861.385044:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832861.385846:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975385728 00000100:00100000:1.0:1788832861.385856:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975385728 00000100:00100000:1.0:1788832861.385923:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:1.0:1788832861.385934:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975385728:12345-192.168.206.41@tcp:41:mkdir.0 00000004:00000024:1.0:1788832861.385973:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788832861.386052:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975385728:12345-192.168.206.41@tcp:41:mkdir.0 Request processed in 120us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832861.386059:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:2.0:1788832861.389160:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975385856 00000100:00100000:2.0:1788832861.389173:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975385856 00000100:00100000:2.0:1788832861.389227:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00100000:2.0:1788832861.389237:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:9727:x1875726975385856:12345-192.168.206.41@tcp:700:mkdir.0 00000100:00100000:2.0:1788832861.389311:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:9727:x1875726975385856:12345-192.168.206.41@tcp:700:mkdir.0 Request processed in 74us (4265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832861.389318:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00080000:3.0:1788832861.391955:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832861.411612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832861.411647:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975386112 00000100:00100000:3.0:1788832861.411656:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975386112 00000100:00100000:3.0:1788832861.413829:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:3.0:1788832861.413844:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:9727:x1875726975386112:12345-192.168.206.41@tcp:36:mkdir.0 00010000:00010000:3.0:1788832861.413896:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832861.413923:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4af4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5532c expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.413941:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:3.0:1788832861.413951:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832861.414236:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4c13 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.414249:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4c13 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.414258:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4c13 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.414313:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4c1a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.414322:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4c1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.414340:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4c1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832861.420277:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788832861.420294:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4c13 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.420303:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4c13 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.420311:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4c13 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.420316:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832861.420321:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4c13 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.420328:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4c13 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.420343:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d113e9300) 00010000:00010000:3.0:1788832861.420345:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832861.420349:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4c13 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.420355:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4c13 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788832861.420377:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3a22875 reply state 00000000811f14c5 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4c1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832861.420394:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788832861.420488:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:9727:x1875726975386112:12345-192.168.206.41@tcp:36:mkdir.0 Request processed in 6645us (8880us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788832861.420497:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 15 00010000:00010000:2.0:1788832861.430602:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4c1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.430619:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4c1a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.430636:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4c1a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.430642:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832861.430647:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4c1a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.430654:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4c1a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.430689:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff984d113e9600) 00010000:00010000:2.0:1788832861.430693:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832861.430698:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4c1a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.430704:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4c1a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832861.437160:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832861.437283:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975386240 00000100:00100000:2.0:1788832861.437292:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975386240 00000100:00100000:2.0:1788832861.437346:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:2.0:1788832861.437357:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:9729:x1875726975386240:12345-192.168.206.41@tcp:101:chmod.0 00010000:00010000:2.0:1788832861.437376:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832861.437397:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a4c21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553b1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.437452:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a4c28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.437476:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a4c28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.437486:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a4c28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832861.437520:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788832861.437523:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788832861.437559:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a4c28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.437585:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a4c21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553b1 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.437602:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a4c28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553b1 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.437610:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0c2cf600) 00010000:00010000:2.0:1788832861.437613:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832861.437617:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703600, rc 0) 00000100:00100000:2.0:1788832861.437685:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:9729:x1875726975386240:12345-192.168.206.41@tcp:101:chmod.0 Request processed in 319us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832861.437693:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:2.0:1788832861.443866:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832861.444014:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975386496 00000100:00100000:1.0:1788832861.444023:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975386496 00000100:00100000:1.0:1788832861.444071:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 17 00000100:00100000:1.0:1788832861.444081:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:9729:x1875726975386496:12345-192.168.206.41@tcp:36:chmod.0 00010000:00010000:1.0:1788832861.444123:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832861.444151:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a4c28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553b1 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.444167:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0c2cf600) 00010000:00010000:1.0:1788832861.444175:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832861.444198:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4c2f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.444210:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4c2f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.444219:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4c2f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832861.444487:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000857cb74b reply state 00000000bd82580e transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4c2f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832861.444496:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788832861.444504:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788832861.444578:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:9729:x1875726975386496:12345-192.168.206.41@tcp:36:chmod.0 Request processed in 498us (720us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788832861.444585:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 17 00010000:00010000:1.0:1788832861.452589:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4c2f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.452606:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4c2f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.452614:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4c2f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.452620:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832861.452636:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4c2f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.452644:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4c2f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.452661:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d02d42300) 00010000:00010000:1.0:1788832861.452664:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788832861.452668:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4c2f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.452692:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4c2f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832861.497730:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832861.497835:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975386624 00000100:00100000:2.0:1788832861.497844:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975386624 00000100:00100000:2.0:1788832861.497902:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 18 00000100:00100000:2.0:1788832861.497912:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:9730:x1875726975386624:12345-192.168.206.41@tcp:101:chown.0 00010000:00010000:2.0:1788832861.497942:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832861.497963:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a4c36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553b8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.498022:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4c3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.498035:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.498046:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832861.498078:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788832861.498082:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788832861.498116:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.498141:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a4c36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553b8 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.498156:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4c3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553b8 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.498165:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0c2cfb00) 00010000:00010000:2.0:1788832861.498168:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832861.498172:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703c00, rc 0) 00000100:00100000:2.0:1788832861.498228:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:9730:x1875726975386624:12345-192.168.206.41@tcp:101:chown.0 Request processed in 317us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832861.498235:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 18 00000100:00100000:1.0:1788832861.514392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832861.514418:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975386752 00000100:00100000:1.0:1788832861.514427:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975386752 00000100:00100000:1.0:1788832861.514472:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 19 00000100:00100000:1.0:1788832861.514481:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:9730:x1875726975386752:12345-192.168.206.41@tcp:101:chown.0 00010000:00010000:1.0:1788832861.514498:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832861.514514:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4c44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553bf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514568:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a4c4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514581:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a4c4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514592:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a4c4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514619:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4c52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514627:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514633:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514712:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a4c59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514720:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a4c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514727:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a4c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832861.514786:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788832861.514790:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788832861.514819:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a4c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514831:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a4c4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514837:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a4c4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514843:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a4c4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514858:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832861.514862:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a4c4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514869:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a4c4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514881:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0c2cfb00) 00010000:00010000:1.0:1788832861.514884:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832861.514888:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a4c4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514894:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a4c4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514905:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514910:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4c52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514916:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4c52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514921:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832861.514923:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4c52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514929:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4c52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514947:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff984d02d42300) 00010000:00010000:1.0:1788832861.514949:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832861.514952:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4c52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514957:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4c52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514987:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4c44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553bf expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.514999:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a4c59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553bf expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.515006:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff984d02d42900) 00010000:00010000:1.0:1788832861.515008:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832861.515010:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05a00, rc 0) 00000100:00100000:1.0:1788832861.515061:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:9730:x1875726975386752:12345-192.168.206.41@tcp:101:chown.0 Request processed in 581us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832861.515075:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 19 00000100:00100000:3.0:1788832861.541040:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832861.541077:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832861.541161:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832861.541196:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975387008 00000100:00100000:3.0:1788832861.541205:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975387008 00000100:00100000:3.0:1788832861.541246:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975387264 00000100:00100000:3.0:1788832861.541249:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975387264 00000100:00100000:3.0:1788832861.541279:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 100 00000100:00100000:3.0:1788832861.541288:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2357:x1875726975387264:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832861.541356:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2357:x1875726975387264:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832861.541364:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 100 00000100:00100000:3.0:1788832861.541381:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 20 00000100:00100000:3.0:1788832861.541388:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:9730:x1875726975387008:12345-192.168.206.41@tcp:36:chown.0 00010000:00010000:3.0:1788832861.541426:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832861.541451:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a4c59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553bf expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.541468:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff984d02d42900) 00010000:00010000:3.0:1788832861.541478:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832861.541512:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4c60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.541524:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4c60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.541534:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4c60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832861.544174:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975387136 00000100:00100000:3.0:1788832861.544188:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975387136 00000100:00100000:3.0:1788832861.544234:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 248 00000100:00100000:3.0:1788832861.544243:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2357:x1875726975387136:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832861.544300:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2357:x1875726975387136:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 58us (3222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832861.544307:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 248 00000100:00080000:3.0:1788832861.544340:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788832861.637534:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1788832861.637553:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788832861.637959:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016d96165 reply state 00000000f458d186 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4c60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832861.637973:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788832861.637986:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1788832861.638085:0:5854:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788832861.638106:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:9730:x1875726975387008:12345-192.168.206.41@tcp:36:chown.0 Request processed in 96714us (97071us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788832861.638114:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 20 00010000:00010000:1.0:1788832861.638627:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4c60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.638637:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4c60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.638646:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4c60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.638668:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832861.638688:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4c60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.638695:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4c60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.638710:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832861.638714:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788832861.638718:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4c60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.638723:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4c60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832861.675377:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832861.675968:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975387392 00000100:00100000:1.0:1788832861.675978:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975387392 00000100:00100000:3.0:1788832861.676309:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 21 00000100:00100000:3.0:1788832861.676348:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:9731:x1875726975387392:12345-192.168.206.41@tcp:101:touch.500 00010000:00010000:3.0:1788832861.676381:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832861.676399:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4c67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553c6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788832861.687111:0:5855:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 10670us 00010000:00010000:3.0:1788832861.727984:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4c6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728008:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4c6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728021:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4c6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728037:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4c75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728044:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4c75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728050:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4c75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728842:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3200/0xd270a10c1c6a4c7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728854:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3200/0xd270a10c1c6a4c7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728862:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3200/0xd270a10c1c6a4c7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832861.728897:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788832861.728901:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788832861.728936:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3200/0xd270a10c1c6a4c7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728948:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4c6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728953:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4c6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728959:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4c6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728964:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832861.728968:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4c6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728974:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4c6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728985:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0c2cfb00) 00010000:00010000:3.0:1788832861.728988:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832861.728992:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4c6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.728997:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4c6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.729007:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4c75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.729023:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4c75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.729029:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4c75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.729033:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832861.729036:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4c75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.729042:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4c75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.729050:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff984d113e9100) 00010000:00010000:3.0:1788832861.729053:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832861.729055:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4c75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.729061:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4c75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.729214:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4c67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553c6 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.729229:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3200/0xd270a10c1c6a4c7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553c6 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.729236:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff984d113e9000) 00010000:00010000:3.0:1788832861.729239:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788832861.729248:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3200, rc 0) 00000100:00100000:3.0:1788832861.729432:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:9731:x1875726975387392:12345-192.168.206.41@tcp:101:touch.500 Request processed in 53087us (54062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832861.729441:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 21 00000100:00100000:3.0:1788832861.734197:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832861.734284:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975387648 00000100:00100000:0.0:1788832861.734293:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975387648 00000100:00100000:0.0:1788832861.734357:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 22 00000100:00100000:0.0:1788832861.734367:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:9731:x1875726975387648:12345-192.168.206.41@tcp:101:touch.500 00010000:00010000:0.0:1788832861.734386:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832861.734406:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4c83 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553cd expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.734649:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4c8a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.734664:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4c8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.734676:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4c8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.734690:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4c91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.734698:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.734717:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788832861.735445:0:7174:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788832861.735687:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4c98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.735700:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.735708:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.735739:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4c8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.735770:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4c8a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.735777:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4c8a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.735783:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207f600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832861.735787:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4c8a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.735794:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4c8a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.735819:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff984d113e9000) 00010000:00010000:0.0:1788832861.735823:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832861.735834:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4c8a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.735840:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4c8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832861.735859:0:7174:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008abe4e51 reply state 00000000c61429aa transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832861.735867:0:7174:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788832861.735895:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4c83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553cd expref: 10 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.735910:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4c98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553cd expref: 9 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.735917:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff984d03c60300) 00010000:00010000:0.0:1788832861.735920:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832861.735922:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d4207fc00, rc 0) 00000100:00100000:0.0:1788832861.735983:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:9731:x1875726975387648:12345-192.168.206.41@tcp:101:touch.500 Request processed in 1617us (1794us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788832861.735991:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 22 00010000:00010000:1.0:1788832861.740164:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.740179:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4c91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.740186:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4c91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.740192:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207e000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832861.740196:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4c91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.740202:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4c91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.740228:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x74bc947d (ffff984d03c60e00) 00010000:00010000:1.0:1788832861.740231:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832861.740236:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4c91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.740242:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4c91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832861.743330:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832861.743578:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975387904 00000100:00100000:2.0:1788832861.743588:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975387904 00000100:00100000:2.0:1788832861.743641:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 23 00000100:00100000:2.0:1788832861.743649:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:9731:x1875726975387904:12345-192.168.206.41@tcp:36:touch.500 00010000:00010000:2.0:1788832861.743701:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832861.743724:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4c98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553cd expref: 9 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.743901:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff984d03c60300) 00010000:00010000:2.0:1788832861.743914:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832861.743953:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a4ca6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.743965:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a4ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832861.743975:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a4ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788832861.744154:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073270404 reply state 000000008765f2cd transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a4ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832861.744163:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832861.744318:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:9731:x1875726975387904:12345-192.168.206.41@tcp:36:touch.500 Request processed in 669us (995us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788832861.744326:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 23 00010000:00010000:1.0:1788832861.750324:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a4ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.750338:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a4ca6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.750356:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a4ca6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.750362:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832861.750366:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a4ca6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.750373:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a4ca6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.750388:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff984d0c2cf500) 00010000:00010000:1.0:1788832861.750391:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832861.750395:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a4ca6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.750401:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a4ca6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832861.751935:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832861.752018:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975388032 00000100:00100000:0.0:1788832861.752027:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975388032 00000100:00100000:0.0:1788832861.752087:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 24 00000100:00100000:0.0:1788832861.752097:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:9731:x1875726975388032:12345-192.168.206.41@tcp:101:touch.500 00010000:00010000:0.0:1788832861.752119:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832861.752139:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4cad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553d4 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.752206:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553d4 expref: 10 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.752219:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553d4 expref: 10 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.752235:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff984d03c60500) 00010000:00010000:0.0:1788832861.752237:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788832861.752240:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d4207f200, rc 0) 00000100:00100000:0.0:1788832861.752292:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:9731:x1875726975388032:12345-192.168.206.41@tcp:101:touch.500 Request processed in 197us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832861.752298:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 24 00000100:00100000:0.0:1788832861.760638:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832861.760835:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975388160 00000100:00100000:1.0:1788832861.760845:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975388160 00000100:00100000:1.0:1788832861.760893:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:1.0:1788832861.760901:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1875726975388160:12345-192.168.206.41@tcp:8:touch.500 00010000:00080000:1.0:1788832861.760931:0:6699:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp t0 exp 0000000000000000 cur 365 last 0 00000020:00000080:1.0:1788832861.760959:0:6699:0:(genops.c:1385:class_connect()) connect: client bee6676f-b533-4465-8162-bf8b5e1e90e6, cookie 0xd270a10c1c6a4cb4 00002000:00100000:1.0:1788832861.760970:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bee6676f-b533-4465-8162-bf8b5e1e90e6/ffff984c054df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788832861.760981:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788832861.761203:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788832861.761232:0:6699:0:(import.c:65:import_set_state_nolock()) ffff984c054da800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788832861.761300:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2356:x1875726975388160:12345-192.168.206.41@tcp:8:touch.500 Request processed in 398us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832861.761308:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:1.0:1788832861.763981:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832861.764588:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975388288 00000100:00100000:3.0:1788832861.764598:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975388288 00000100:00100000:3.0:1788832861.764809:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 17 00000100:00100000:3.0:1788832861.764820:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:0:x1875726975388288:12345-192.168.206.41@tcp:2:touch.500 00000100:00080000:0.0:1788832861.768078:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788832861.781929:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788832861.818171:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bee6676f-b533-4465-8162-bf8b5e1e90e6 00000001:00080000:2.0:1788832861.818189:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1788832861.818607:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:0:x1875726975388288:12345-192.168.206.41@tcp:2:touch.500 Request processed in 53784us (54629us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788832861.818619:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 17 00000100:00100000:3.0:1788832861.826432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832861.826638:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975388544 00000100:00100000:2.0:1788832861.826657:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975388544 00000100:00100000:2.0:1788832861.826707:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 2 00000100:00100000:2.0:1788832861.826717:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:9731:x1875726975388544:12345-192.168.206.41@tcp:35:touch.500 00000100:00100000:2.0:1788832861.827057:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:9731:x1875726975388544:12345-192.168.206.41@tcp:35:touch.500 Request processed in 340us (631us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788832861.827166:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 2 00000100:00100000:0.0:1788832861.873714:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832861.875068:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975388672 00000100:00100000:3.0:1788832861.875081:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975388672 00000100:00100000:3.0:1788832861.875143:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 25 00000100:00100000:3.0:1788832861.875153:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:9732:x1875726975388672:12345-192.168.206.41@tcp:101:rm.0 00010000:00010000:3.0:1788832861.875175:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832861.875193:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4cbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553db expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.875252:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4cc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.875265:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.875276:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832861.875345:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788832861.875349:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788832861.875389:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.875412:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4cbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553db expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.875426:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553db expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.875434:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff984d113e9000) 00010000:00010000:3.0:1788832861.875437:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832861.875440:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2200, rc 0) 00000100:00100000:3.0:1788832861.875502:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:9732:x1875726975388672:12345-192.168.206.41@tcp:101:rm.0 Request processed in 350us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832861.875509:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 25 00000100:00100000:1.0:1788832861.885951:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832861.886047:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975388928 00000100:00100000:0.0:1788832861.886057:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975388928 00000100:00100000:0.0:1788832861.886116:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 26 00000100:00100000:0.0:1788832861.886126:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:9732:x1875726975388928:12345-192.168.206.41@tcp:101:rm.0 00010000:00010000:0.0:1788832861.886145:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832861.886165:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4cc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553e2 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832861.886244:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788832861.886401:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4cc9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553e2 expref: 14 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.886422:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0c2cfb00) 00010000:00010000:0.0:1788832861.886425:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788832861.886430:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4cc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553e2 expref: 14 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.886449:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d4207e600, rc 0) 00000100:00100000:0.0:1788832861.886508:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:9732:x1875726975388928:12345-192.168.206.41@tcp:101:rm.0 Request processed in 383us (565us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788832861.886515:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 26 00000100:00100000:1.0:1788832861.895465:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832861.895826:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975389056 00000100:00100000:2.0:1788832861.895836:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975389056 00000100:00100000:2.0:1788832861.895889:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 3 00000100:00100000:2.0:1788832861.895899:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:9732:x1875726975389056:12345-192.168.206.41@tcp:37:rm.0 00000100:00100000:3.0:1788832861.903273:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:9732:x1875726975389056:12345-192.168.206.41@tcp:37:rm.0 Request processed in 7368us (7807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832861.903286:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 3 00000100:00100000:1.0:1788832861.907403:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832861.907498:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975389312 00000100:00100000:0.0:1788832861.907508:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975389312 00000100:00100000:0.0:1788832861.907559:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 4 00000100:00100000:0.0:1788832861.907569:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d18422450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:9732:x1875726975389312:12345-192.168.206.41@tcp:35:rm.0 00000100:00100000:0.0:1788832861.907840:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d18422450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:9732:x1875726975389312:12345-192.168.206.41@tcp:35:rm.0 Request processed in 272us (443us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788832861.907849:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 4 00000100:00100000:1.0:1788832861.911348:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832861.911524:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975389568 00000100:00100000:3.0:1788832861.911534:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975389568 00000100:00100000:3.0:1788832861.911595:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 27 00000100:00100000:3.0:1788832861.911605:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:9732:x1875726975389568:12345-192.168.206.41@tcp:101:rm.0 00010000:00010000:3.0:1788832861.911626:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832861.911646:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4cd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553e9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.911792:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4cde lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.911816:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4cde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.911828:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4cde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832861.911839:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788832861.911953:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4cd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553e9 expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.911970:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4cde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553e9 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.911979:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff984d113e9000) 00010000:00010000:3.0:1788832861.911982:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832861.911985:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2600, rc 0) 00000100:00100000:3.0:1788832861.912042:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:9732:x1875726975389568:12345-192.168.206.41@tcp:101:rm.0 Request processed in 438us (703us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788832861.912048:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 27 00000100:00100000:2.0:1788832861.915703:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832861.915825:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975389696 00000100:00100000:0.0:1788832861.915834:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975389696 00000100:00100000:0.0:1788832861.915893:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 28 00000100:00100000:0.0:1788832861.915903:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:9732:x1875726975389696:12345-192.168.206.41@tcp:41:rm.0 00000004:00000024:0.0:1788832861.915954:0:7174:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788832861.916023:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:9732:x1875726975389696:12345-192.168.206.41@tcp:41:rm.0 Request processed in 121us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832861.916030:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 28 00000100:00100000:1.0:1788832861.919829:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832861.919909:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975389824 00000100:00100000:3.0:1788832861.919919:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975389824 00000100:00100000:3.0:1788832861.919975:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 29 00000100:00100000:3.0:1788832861.919985:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:9732:x1875726975389824:12345-192.168.206.41@tcp:101:rm.0 00010000:00010000:3.0:1788832861.920002:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832861.920031:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4cec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553f0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920101:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4cf3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920116:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920128:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920144:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4cfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920152:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920158:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920242:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4d01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920250:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920257:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832861.920281:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788832861.920285:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788832861.920300:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920318:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920326:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920332:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4cf3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920339:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920345:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832861.920349:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920356:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4cf3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920368:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff984d113e9000) 00010000:00010000:3.0:1788832861.920371:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832861.920375:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4cf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920381:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4cf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920393:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920399:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4cfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920409:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4cfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920414:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832861.920416:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4cfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920422:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4cfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920429:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x74bc947d (ffff984d113e9500) 00010000:00010000:3.0:1788832861.920431:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832861.920433:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4cfa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920438:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4cfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920469:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4cec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553f0 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920481:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4d01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553f0 expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.920488:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff984d03c60500) 00010000:00010000:3.0:1788832861.920490:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832861.920493:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2000, rc 0) 00000100:00100000:3.0:1788832861.920544:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:9732:x1875726975389824:12345-192.168.206.41@tcp:101:rm.0 Request processed in 560us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832861.920560:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 29 00000100:00100000:1.0:1788832861.923610:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832861.923695:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975390080 00000100:00100000:0.0:1788832861.923704:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975390080 00000100:00100000:0.0:1788832861.923786:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 30 00000100:00100000:0.0:1788832861.923805:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fadad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:9732:x1875726975390080:12345-192.168.206.41@tcp:36:rm.0 00010000:00010000:0.0:1788832861.923852:0:7174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788832861.923875:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4d01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553f0 expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.923895:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4cad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553d4 expref: 16 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.923909:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff984d03c60500) 00010000:00010000:0.0:1788832861.923922:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4cc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553db expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.923930:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff984d113e9000) 00010000:00010000:0.0:1788832861.923933:0:7174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832861.923950:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4d08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.923960:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4d08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.923969:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4d08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.923981:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4d0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.923987:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.924005:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.924110:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4d16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.924119:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4d16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.924126:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4d16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788832861.924837:0:7174:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788832861.924848:0:7174:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365615104344ns, next at 366615101842ns, rc = 0 00010000:00010000:0.0:1788832861.924906:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4d1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.924916:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.924924:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.924931:0:7174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4d1d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.924938:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4d1d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.924944:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.924974:0:7174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788832861.924992:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4d16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.924998:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4d16 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.925003:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4d16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.925009:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207fc00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832861.925013:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4d16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.925020:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4d16 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.925030:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff984d03c60900) 00010000:00010000:0.0:1788832861.925033:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788832861.925037:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4d16 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.925043:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4d16 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.925062:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4d08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.925067:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4d08 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.925073:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4d08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.925084:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207e600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832861.925087:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4d08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.925094:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4d08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.925102:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff984d113e9000) 00010000:00010000:0.0:1788832861.925104:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832861.925107:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4d08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832861.925112:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4d08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832861.925124:0:7174:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068852f1b reply state 00000000c78b6506 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832861.925133:0:7174:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788832861.925218:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fadad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:9732:x1875726975390080:12345-192.168.206.41@tcp:36:rm.0 Request processed in 1420us (1612us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788832861.925225:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 30 00010000:00010000:1.0:1788832861.925340:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832861.925346:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4d1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.925357:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207e000 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788832861.925360:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4d1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.925366:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.925374:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff984d03c60900) 00010000:00010000:1.0:1788832861.925376:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788832861.925379:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4d1d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.925384:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e000/0xd270a10c1c6a4d1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.925398:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832861.925400:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832861.925401:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832861.929477:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.929492:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4d0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.929499:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.929505:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207f600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832861.929509:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.929532:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4d0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.929547:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x74bc947d (ffff984d03c60700) 00010000:00010000:1.0:1788832861.929550:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832861.929554:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4d0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.929561:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4d0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832861.930424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832861.930487:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975390336 00000100:00100000:0.0:1788832861.930496:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975390336 00000100:00100000:0.0:1788832861.930546:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 5 00000100:00100000:0.0:1788832861.930556:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:9732:x1875726975390336:12345-192.168.206.41@tcp:35:rm.0 00000100:00100000:0.0:1788832861.930817:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:9732:x1875726975390336:12345-192.168.206.41@tcp:35:rm.0 Request processed in 262us (398us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788832861.930839:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 5 00000100:00100000:0.0:1788832861.934004:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832861.934202:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975390592 00000100:00100000:3.0:1788832861.934212:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975390592 00000100:00100000:3.0:1788832861.934268:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 31 00000100:00100000:3.0:1788832861.934278:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:9732:x1875726975390592:12345-192.168.206.41@tcp:36:rm.0 00010000:00010000:3.0:1788832861.934329:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788832861.934354:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4cde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553e9 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.934375:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3200/0xd270a10c1c6a4c7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553c6 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.934384:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff984d113e9000) 00010000:00010000:3.0:1788832861.934401:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4c3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553b8 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.934410:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0c2cfb00) 00010000:00010000:3.0:1788832861.934415:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832861.934438:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4d24 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.934450:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4d24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.934458:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4d24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.934469:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4d2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.934488:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4d2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.934496:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4d2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.934693:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4d32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.934702:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4d32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.934709:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4d32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832861.935534:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788832861.935550:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4d32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.935557:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4d32 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.935564:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4d32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.935569:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832861.935573:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4d32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.935581:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4d32 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.935603:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff984d113e9c00) 00010000:00010000:3.0:1788832861.935606:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788832861.935610:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4d32 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.935616:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3c00/0xd270a10c1c6a4d32 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.935637:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4d24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.935644:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4d24 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.935650:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4d24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.935655:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832861.935657:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4d24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.935663:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4d24 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.935671:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d113e9500) 00010000:00010000:3.0:1788832861.935674:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832861.935677:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4d24 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832861.935682:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a4d24 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788832861.935706:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000ab2f99 reply state 000000001b80fb16 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4d2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832861.935714:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788832861.936617:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:9732:x1875726975390592:12345-192.168.206.41@tcp:36:rm.0 Request processed in 2335us (2615us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788832861.936626:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 31 00010000:00010000:1.0:1788832861.939240:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4d2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.939257:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4d2b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.939265:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4d2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.939271:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832861.939276:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4d2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.939284:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4d2b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.939299:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff984d113e9100) 00010000:00010000:1.0:1788832861.939303:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832861.939320:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4d2b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832861.939327:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4d2b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832862.808151:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832862.870098:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994296448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832862.870168:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832862.870333:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994296448 00000100:00100000:1.0:1788832862.870340:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994296448 00000100:00100000:1.0:1788832862.870391:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788832862.870400:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994296448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832862.870434:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832862.870483:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994296448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832862.870490:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788832862.870584:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3fadb100 x1875726994296448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832862.870602:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994296448:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788832863.829886:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832864.854100:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788832865.817069:0:11635:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788832865.878881:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832866.455869:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994296832:0@lo:400:kworker.0 00000100:00100000:2.0:1788832866.456030:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994296960:0@lo:400:kworker.0 00000100:00100000:3.0:1788832866.456109:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994296576:0@lo:400:kworker.0 00000100:00100000:0.0:1788832866.456165:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994296704:0@lo:400:kworker.0 00000100:00100000:1.0:1788832866.456258:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832866.461255:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832866.461351:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994296960 00000100:00100000:2.0:1788832866.461359:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994296960 00000100:00100000:2.0:1788832866.461416:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788832866.461425:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994296960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832866.461478:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994296960:12345-0@lo:400:kworker.0 Request processed in 54us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832866.461485:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788832866.461542:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398fb800 x1875726994296960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832866.461555:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994296960:0@lo:400:kworker.0 00000100:00100000:3.0:1788832866.461867:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832866.461902:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994297088:0@lo:400:kworker.0 00000100:00100000:3.0:1788832866.461941:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994296576 00000100:00100000:3.0:1788832866.461945:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994296576 00000100:00100000:3.0:1788832866.461976:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788832866.461983:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994296576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832866.462032:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994296576:12345-0@lo:400:kworker.0 Request processed in 49us (166us total) trans 0 rc 0/0 00000100:00080000:0.0:1788832866.462738:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832866.462767:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994296832 00000100:00100000:0.0:1788832866.462773:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994296832 00000100:00100000:0.0:1788832866.462830:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788832866.462839:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994296832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832866.462887:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994296832:12345-0@lo:400:kworker.0 Request processed in 50us (6629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832866.462894:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1788832866.462919:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832866.463715:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000004:00080000:0.0:1788832866.463967:0:7729:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370154221915ns, next at 371154219715ns, rc = 0 00000100:00100000:1.0:1788832866.469865:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994296832:0@lo:400:kworker.0 00000100:00100000:1.0:1788832866.469901:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994297344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832866.469953:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832866.469994:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994297344 00000100:00100000:1.0:1788832866.470014:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994297344 00000100:00100000:1.0:1788832866.470074:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788832866.470082:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994297344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832866.470115:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832866.470155:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994297344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832866.470174:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788832866.470193:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788832866.470215:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b2b6a00 x1875726994297344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832866.470230:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994297344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832866.470379:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832866.470414:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994297216:0@lo:400:kworker.0 00000100:00100000:2.0:1788832866.470439:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832866.470507:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832866.470549:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994296576:0@lo:400:kworker.0 00000100:00100000:2.0:1788832866.470600:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994296704 00000100:00100000:2.0:1788832866.470604:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994296704 00000100:00100000:2.0:1788832866.470644:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994297088 00000100:00100000:2.0:1788832866.470647:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994297088 00000100:00100000:2.0:1788832866.470668:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788832866.470674:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994296704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832866.470713:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994296704:12345-0@lo:400:kworker.0 Request processed in 38us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832866.470719:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788832866.470731:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788832866.470737:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994297088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832866.470807:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994297088:12345-0@lo:400:kworker.0 Request processed in 69us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832866.470813:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788832866.470839:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994296704:0@lo:400:kworker.0 00000100:00100000:3.0:1788832866.470972:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994297088:0@lo:400:kworker.0 00000100:00100000:1.0:1788832866.471246:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994297216 00000100:00100000:1.0:1788832866.471250:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994297216 00000100:00100000:1.0:1788832866.471285:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788832866.471292:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994297216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832866.471334:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994297216:12345-0@lo:400:kworker.0 Request processed in 42us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832866.471340:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788832866.471356:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788832866.471439:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d398f9c00 x1875726994297216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832866.471450:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994297216:0@lo:400:kworker.0 00000100:00100000:0.0:1788832866.651349:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832866.651385:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832866.651437:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832866.651478:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832866.651515:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975390720 00000100:00100000:0.0:1788832866.651515:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975390848 00000100:00100000:0.0:1788832866.651526:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975390848 00000100:00100000:3.0:1788832866.651527:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975390720 00000100:00100000:3.0:1788832866.651576:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 250 00000100:00100000:0.0:1788832866.651582:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975391104 00000100:00100000:0.0:1788832866.651588:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975391104 00000100:00100000:3.0:1788832866.651589:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2358:x1875726975390720:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832866.651616:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 104 00000100:00100000:0.0:1788832866.651625:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:2357:x1875726975390848:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832866.651660:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2358:x1875726975390720:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 75us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832866.651669:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:2357:x1875726975390848:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 44us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832866.651671:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 250 00000100:00100000:0.0:1788832866.651691:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 104 00000100:00100000:0.0:1788832866.651715:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 105 00000100:00100000:0.0:1788832866.651723:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2357:x1875726975391104:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832866.651806:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2357:x1875726975391104:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 84us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832866.651825:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 105 00000100:00080000:3.0:1788832866.651850:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832866.653357:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975390976 00000100:00100000:2.0:1788832866.653378:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975390976 00000100:00100000:2.0:1788832866.653489:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 48 00000100:00100000:2.0:1788832866.653498:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975390976:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832866.653560:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975390976:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 64us (2174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832866.653568:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 48 00000100:00080000:3.0:1788832866.653624:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1788832866.774110:0:11683:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1b2f0d40 20000000:00000080:1.0:1788832866.774233:0:11683:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984d3a144800 uarg=0000000000000000 20000000:01000000:1.0:1788832866.774267:0:11683:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788832866.774274:0:11683:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788832866.774279:0:11683:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788832866.774988:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788832866.775183:0:11683:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788832866.779624:0:11683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788832866.779683:0:11683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788832866.779965:0:11683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788832866.779986:0:11683:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788832866.780014:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832866.780347:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a4bdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553a3 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832866.780363:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4be2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553aa expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832866.780371:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d3b703400/0xd270a10c1c6a4bf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4be9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832866.780378:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d3ada3400/0xd270a10c1c6a4bfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4bf7 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832866.780384:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d3b703a00/0xd270a10c1c6a4c0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4c05 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832866.780391:0:11683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832866.780424:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d3b703a00/0xd270a10c1c6a4c0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4c05 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832866.780439:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d3b703a00/0xd270a10c1c6a4c0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4c05 expref: 18 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832866.780452:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11683:1875726994297472:0@lo:104: 00000100:00100000:1.0:1788832866.780510:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788832866.780601:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d3ada3400/0xd270a10c1c6a4bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4bf7 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832866.780610:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d3ada3400/0xd270a10c1c6a4bfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4bf7 expref: 18 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832866.780630:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11683:1875726994297600:0@lo:104: 00000100:00100000:1.0:1788832866.780654:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788832866.781406:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d3b703400/0xd270a10c1c6a4bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a4be9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832866.781417:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d3b703400/0xd270a10c1c6a4bf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a4be9 expref: 18 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832866.781427:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11683:1875726994297728:0@lo:104: 00000100:00100000:1.0:1788832866.781451:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832866.781508:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994297472 00000100:00100000:3.0:1788832866.781515:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994297472 00000100:00100000:3.0:1788832866.781547:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994297600 00000100:00100000:3.0:1788832866.781549:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994297600 00000100:00100000:3.0:1788832866.781560:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788832866.781567:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+4:11683:x1875726994297472:12345-0@lo:104: 00010000:00010000:3.0:1788832866.781578:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4c0c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.781626:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788832866.781632:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+4:11683:x1875726994297472:12345-0@lo:104: Request processed in 65us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832866.781638:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788832866.781656:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788832866.781661:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:11683:x1875726994297600:12345-0@lo:104: 00010000:00010000:3.0:1788832866.781668:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4bfe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.781697:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788832866.781702:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:11683:x1875726994297600:12345-0@lo:104: Request processed in 41us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832866.781707:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788832866.781730:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788832866.781736:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4c0c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.781762:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3000 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1788832866.781766:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4c0c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.781782:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4c0c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832866.781790:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4c0c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832866.781796:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788832866.781821:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4c0c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.781827:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832866.781845:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4c0c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.781851:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d3ada3000/0xd270a10c1c6a4c05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4c0c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.781864:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832866.781867:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4bfe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.781873:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702e00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1788832866.781876:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4bfe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.781889:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4bfe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832866.781896:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4bfe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832866.781901:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788832866.781914:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4bfe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.781919:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832866.781926:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4bfe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.781932:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d3b702e00/0xd270a10c1c6a4bf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4bfe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.781942:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832866.781943:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832866.781945:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832866.781956:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994297856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788832866.781983:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832866.782016:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832866.782021:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994297984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788832866.782053:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832866.782082:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994297856 00000100:00100000:3.0:1788832866.782086:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994297856 00010000:00010000:3.0:1788832866.782103:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d3b703a00/0xd270a10c1c6a4c0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4c05 expref: 19 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832866.782136:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994297984 00000100:00100000:3.0:1788832866.782139:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994297984 00010000:00010000:3.0:1788832866.782151:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d3ada3400/0xd270a10c1c6a4bfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4bf7 expref: 20 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832866.782167:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788832866.782174:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+20:3314:x1875726994297856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788832866.782184:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832866.782188:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d3b703a00/0xd270a10c1c6a4c0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4c05 expref: 20 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.782197:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d3b703a00/0xd270a10c1c6a4c0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4c05 expref: 20 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.782210:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832866.782237:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+20:3314:x1875726994297856:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832866.782243:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788832866.782257:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788832866.782263:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994297984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788832866.782270:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832866.782273:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d3ada3400/0xd270a10c1c6a4bfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4bf7 expref: 19 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.782281:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d3ada3400/0xd270a10c1c6a4bfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4bf7 expref: 19 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.782291:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832866.782318:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994297984:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832866.782324:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788832866.782358:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994297984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788832866.782365:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994297856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832866.782482:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832866.782657:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553aa expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832866.782668:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4be2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553aa expref: 12 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832866.782678:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11683:1875726994298112:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832866.782813:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a4bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553a3 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832866.782822:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a4bdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553a3 expref: 12 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832866.782832:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11683:1875726994298240:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832866.782854:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d02b31a80 going to sleep for 11 seconds 00010000:00010000:1.0:1788832866.782866:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b703a00/0xd270a10c1c6a4c0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4c05 expref: 18 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832866.782887:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11683:1875726994297472:0@lo:104: 00010000:00010000:1.0:1788832866.782897:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3ada3400/0xd270a10c1c6a4bfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4bf7 expref: 17 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832866.782905:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11683:1875726994297600:0@lo:104: 00000100:00100000:3.0:1788832866.782980:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788832866.783002:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994297728 00000100:00100000:3.0:1788832866.783006:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994297728 00000100:00100000:3.0:1788832866.783028:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788832866.783033:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a795050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:11683:x1875726994297728:12345-0@lo:104: 00010000:00010000:3.0:1788832866.783130:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4bf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.783177:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788832866.783183:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a795050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd32c45e-9a6a-4349-b87e-107522b34816+3:11683:x1875726994297728:12345-0@lo:104: Request processed in 150us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832866.783190:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788832866.783221:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832866.783226:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a4bf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.783233:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d013d0e00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1788832866.783237:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a4bf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.783244:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a4bf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832866.783261:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a4bf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832866.783267:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788832866.783285:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4bf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.783291:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832866.783305:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4bf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.783312:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d013d0e00/0xd270a10c1c6a4be9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a4bf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.783325:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832866.783327:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832866.783328:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832866.783337:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994298368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788832866.783360:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832866.783384:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994298368 00000100:00100000:3.0:1788832866.783387:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994298368 00010000:00010000:3.0:1788832866.783399:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d3b703400/0xd270a10c1c6a4bf0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4be9 expref: 17 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832866.783415:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788832866.783420:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d08a81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+17:3316:x1875726994298368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788832866.783426:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832866.783430:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d3b703400/0xd270a10c1c6a4bf0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a4be9 expref: 17 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.783444:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d3b703400/0xd270a10c1c6a4bf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a4be9 expref: 17 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.783456:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832866.783481:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d08a81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32c45e-9a6a-4349-b87e-107522b34816+17:3316:x1875726994298368:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832866.783487:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788832866.783531:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994298368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788832866.783592:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b703400/0xd270a10c1c6a4bf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a4be9 expref: 16 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832866.783601:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11683:1875726994297728:0@lo:104: 00000100:00100000:2.0:1788832866.787484:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11683:1875726994298112:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832866.787498:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11683:1875726994298240:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832866.787535:0:11683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832866.789890:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832866.790007:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832866.790572:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975391360 00000100:00100000:3.0:1788832866.790584:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975391360 00010000:00010000:3.0:1788832866.790620:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a4bdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553a3 expref: 13 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832866.790658:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975391232 00000100:00100000:3.0:1788832866.790661:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975391232 00010000:00010000:3.0:1788832866.790673:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4be2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553aa expref: 14 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832866.790708:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 33 00000100:00100000:3.0:1788832866.790717:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+14:2357:x1875726975391360:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832866.790729:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832866.790734:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a4bdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553a3 expref: 14 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.790766:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a4bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553a3 expref: 14 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.790791:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d0a00/0xd270a10c1c6a4bdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553a3 expref: 14 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.790816:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832866.790859:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2357:x1875726975391360:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 144us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832866.790867:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 33 00000100:00100000:3.0:1788832866.790882:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 34 00000100:00100000:3.0:1788832866.790888:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:2357:x1875726975391232:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832866.790895:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832866.790899:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4be2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553aa expref: 12 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.790909:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553aa expref: 12 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.790919:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d1800/0xd270a10c1c6a4be2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553aa expref: 12 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.790930:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.790939:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.790953:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.790961:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.790976:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.790983:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.790989:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05a00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788832866.791148:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.791157:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.791170:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832866.791181:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832866.791200:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:2357:x1875726975391232:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 312us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832866.791207:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 34 00010000:00010000:2.0:1788832866.791278:0:11683:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832866.791287:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832866.791294:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d05f05a00/0xd270a10c1c6a4d39 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832866.904206:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788832867.016383:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788832867.016401:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1788832867.016407:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788832867.016426:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1788832867.016520:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994298496:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788832867.016577:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832867.016923:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994298496 00000100:00100000:0.0:1788832867.016930:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994298496 00000100:00100000:0.0:1788832867.017010:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788832867.017022:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994298496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788832867.017194:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788832867.017227:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f6c5e, atime: 0x6a9f6c5e, ctime: 0x6a9f6c5e, blocks: 0x1 00010000:00010000:0.0:1788832867.017235:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a4d40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832867.017249:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=370s v=(0 0) 00010000:00010000:0.0:1788832867.017254:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832867.017261:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a4d40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832867.017288:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a4d40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832867.017298:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a4d40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832867.017313:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a4d40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832867.017335:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788832867.017819:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1875726994298496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 799us (1240us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788832867.017827:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788832867.017834:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832867.017841:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a4d40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832867.017850:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207e000 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788832867.017855:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a4d40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832867.017875:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a4d40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832867.017892:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a4d40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788832867.017898:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984d3ac91500/2, rc 0, transno 4294967300 00010000:00010000:2.0:1788832867.017899:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a4d40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832867.017903:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994298496:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788832867.017921:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832867.017923:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832867.017925:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832867.866873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832867.867148:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975391488 00000100:00100000:3.0:1788832867.867158:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975391488 00000100:00100000:3.0:1788832867.867221:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 251 00000100:00100000:3.0:1788832867.867229:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:5598:x1875726975391488:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832867.867244:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832867.867263:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3ada3000/0xd270a10c1c6a4d47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553f7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832867.867287:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3ada3000/0xd270a10c1c6a4d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553f7 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832867.867324:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3ada3000/0xd270a10c1c6a4d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553f7 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832867.867333:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3000, rc 0) 00000100:00100000:3.0:1788832867.867391:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:5598:x1875726975391488:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 Request processed in 162us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832867.867398:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 251 00000100:00100000:1.0:1788832867.874958:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832867.875241:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975391616 00000100:00100000:3.0:1788832867.875250:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975391616 00000100:00100000:3.0:1788832867.875348:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 252 00000100:00100000:3.0:1788832867.875358:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:5598:x1875726975391616:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832867.875621:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:5598:x1875726975391616:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 Request processed in 263us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832867.875629:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 252 00000100:00100000:2.0:1788832867.877676:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832867.877789:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975391744 00000100:00100000:1.0:1788832867.877797:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975391744 00000100:00100000:1.0:1788832867.877843:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 253 00000100:00100000:1.0:1788832867.877852:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:5598:x1875726975391744:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832867.878062:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:5598:x1875726975391744:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 Request processed in 210us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832867.878070:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 253 00000100:00100000:1.0:1788832867.881605:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832867.882559:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975391872 00000100:00100000:3.0:1788832867.882571:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975391872 00000100:00100000:3.0:1788832867.882673:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 254 00000100:00100000:3.0:1788832867.882683:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:10002:x1875726975391872:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788832867.883000:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:10002:x1875726975391872:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 318us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832867.883008:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 254 00000100:00100000:2.0:1788832867.885888:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832867.887103:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975392000 00000100:00100000:0.0:1788832867.887115:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975392000 00000100:00100000:0.0:1788832867.887416:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 255 00000100:00100000:0.0:1788832867.887428:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:10002:x1875726975392000:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788832867.887716:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:10002:x1875726975392000:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 283us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832867.887731:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 255 00000100:00100000:2.0:1788832867.891506:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832867.891586:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975392128 00000100:00100000:3.0:1788832867.891595:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975392128 00000100:00100000:3.0:1788832867.891646:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 256 00000100:00100000:3.0:1788832867.891657:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:5598:x1875726975392128:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832867.891684:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832867.891708:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3ada2a00/0xd270a10c1c6a4d4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b553fe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832867.891735:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3ada2a00/0xd270a10c1c6a4d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553fe expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832867.891779:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3ada2a00/0xd270a10c1c6a4d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553fe expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832867.891788:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2a00, rc 0) 00000100:00100000:3.0:1788832867.891845:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:5598:x1875726975392128:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 Request processed in 190us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832867.891853:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 256 00000100:00100000:2.0:1788832867.895962:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832867.897946:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975392256 00000100:00100000:0.0:1788832867.897960:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975392256 00000100:00100000:0.0:1788832867.898027:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 257 00000100:00100000:0.0:1788832867.898038:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:5598:x1875726975392256:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832867.899493:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:5598:x1875726975392256:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 Request processed in 1450us (3532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832867.899504:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 257 00000100:00100000:2.0:1788832867.903850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832867.904603:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975392384 00000100:00100000:1.0:1788832867.904615:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975392384 00000100:00100000:1.0:1788832867.904679:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 258 00000100:00100000:1.0:1788832867.904699:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:5598:x1875726975392384:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832867.905157:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:5598:x1875726975392384:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 Request processed in 468us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832867.905166:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 258 00000100:00100000:2.0:1788832867.912792:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832867.913075:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975392512 00000100:00100000:0.0:1788832867.913085:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975392512 00000100:00100000:0.0:1788832867.913134:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 259 00000100:00100000:0.0:1788832867.913144:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:10004:x1875726975392512:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788832867.913396:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:10004:x1875726975392512:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 251us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832867.913403:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 259 00000100:00100000:2.0:1788832867.917554:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832867.917627:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975392640 00000100:00100000:1.0:1788832867.917636:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975392640 00000100:00100000:1.0:1788832867.917732:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 260 00000100:00100000:1.0:1788832867.917760:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:10004:x1875726975392640:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788832867.918022:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:10004:x1875726975392640:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 281us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832867.918041:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 260 00010000:00010000:3.0:1788832867.925955:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832867.990027:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994298624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832867.990101:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832867.990357:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994298624 00000100:00100000:1.0:1788832867.990366:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994298624 00000100:00100000:1.0:1788832867.990416:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788832867.990426:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994298624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832867.990459:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832867.990515:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994298624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832867.990523:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788832867.990637:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3989d180 x1875726994298624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832867.990655:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994298624:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1788832868.438392:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788832868.438400:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d07487000 from 7 10000000:01000000:1.0:1788832868.438405:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788832868.438451:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832868.438463:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832868.438490:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832868.438514:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994298752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788832868.438575:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832868.438640:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d02b31600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832868.439955:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994298752 00000100:00100000:3.0:1788832868.439967:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994298752 00000100:00100000:3.0:1788832868.440222:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788832868.440234:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+16:5850:x1875726994298752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832868.440261:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832868.440277:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3ada3c00/0xd270a10c1c6a4d5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4d55 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832868.440315:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3ada3c00/0xd270a10c1c6a4d5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4d55 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832868.440345:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3ada3c00/0xd270a10c1c6a4d5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4d55 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832868.440355:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3c00, rc 0) 00000100:00100000:3.0:1788832868.440436:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994298752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832868.440444:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788832868.440558:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994298752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832868.440576:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832868.440587:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832868.440662:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994298880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832868.440695:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832868.446517:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d02b31600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832868.446623:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994298880 00000100:00100000:3.0:1788832868.446633:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994298880 00000100:00100000:3.0:1788832868.446680:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788832868.446689:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994298880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832868.447024:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994298880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 335us (6327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832868.447039:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788832868.449646:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994298880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832868.449731:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994299008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832868.449855:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832868.449905:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d02b31600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832868.450021:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994299008 00000100:00100000:3.0:1788832868.450029:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994299008 00000100:00100000:3.0:1788832868.450085:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788832868.450095:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994299008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832868.450957:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994299008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 860us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832868.450967:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788832868.452337:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994299008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832868.454848:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aba7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:11698:1875726994299136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832868.454945:0:11698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832868.455000:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832868.455072:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994299136 00000100:00100000:2.0:1788832868.455081:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994299136 00000100:00100000:2.0:1788832868.455148:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788832868.455158:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:11698:x1875726994299136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832868.456053:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:11698:x1875726994299136:12345-0@lo:502:llog_process_th.0 Request processed in 894us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832868.456074:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788832868.456086:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aba7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:11698:1875726994299136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788832868.456127:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832868.456138:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832868.456142:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788832868.456149:0:11698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984d07487000 00000020:00000080:3.0:1788832868.456152:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788832868.456255:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aba7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:11698:1875726994299264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832868.456293:0:11698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832868.459713:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994299264 00000100:00100000:0.0:1788832868.459783:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994299264 00000100:00100000:0.0:1788832868.459851:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788832868.459861:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:11698:x1875726994299264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832868.460122:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+17:11698:x1875726994299264:12345-0@lo:502:llog_process_th.0 Request processed in 262us (3828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832868.460131:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788832868.460256:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832868.460282:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aba7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:11698:1875726994299264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832868.460316:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832868.461268:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832868.461274:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788832868.461280:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788832868.462377:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788832868.462407:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832868.462417:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832868.462441:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832868.462451:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788832868.462453:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d39f1a000 from 7 10000000:01000000:0.0:1788832868.462456:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788832868.462490:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832868.462499:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832868.462509:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832868.462535:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994299392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788832868.462596:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832868.462643:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d0bcc6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788832868.462790:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994299392 00000100:00100000:2.0:1788832868.462798:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994299392 00000100:00100000:2.0:1788832868.462837:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788832868.462846:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+17:5850:x1875726994299392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832868.462857:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832868.462869:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b702e00/0xd270a10c1c6a4d6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4d63 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832868.462891:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b702e00/0xd270a10c1c6a4d6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4d63 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832868.462902:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b702e00/0xd270a10c1c6a4d6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4d63 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832868.462911:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702e00, rc 0) 00000100:00100000:2.0:1788832868.462952:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994299392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832868.462959:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788832868.462997:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994299392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832868.463010:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832868.463394:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832868.463450:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994299520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832868.463479:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832868.463506:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18143d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788832868.463520:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994299520 00000100:00100000:2.0:1788832868.463524:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994299520 00000100:00100000:2.0:1788832868.463547:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788832868.463554:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994299520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832868.463811:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994299520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832868.463818:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788832868.463849:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994299520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832868.463879:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994299648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832868.463915:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832868.463934:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18143d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788832868.463944:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994299648 00000100:00100000:2.0:1788832868.463947:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994299648 00000100:00100000:2.0:1788832868.463965:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788832868.463970:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994299648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832868.465724:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994299648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1745us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832868.465736:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788832868.474892:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994299648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832868.475380:0:11701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aba7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:11701:1875726994299776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832868.475448:0:11701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832868.475498:0:11701:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832868.475603:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994299776 00000100:00100000:2.0:1788832868.475610:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994299776 00000100:00100000:2.0:1788832868.475659:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788832868.475668:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:11701:x1875726994299776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832868.475949:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+18:11701:x1875726994299776:12345-0@lo:502:llog_process_th.0 Request processed in 281us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832868.475957:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788832868.477899:0:11701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aba7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:11701:1875726994299776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788832868.477938:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832868.477954:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832868.477956:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788832868.477963:0:11701:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984d39f1a000 00000020:00000080:1.0:1788832868.477965:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788832868.479217:0:11701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:11701:1875726994299904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832868.479284:0:11701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832868.479342:0:11701:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d067570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832868.479507:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994299904 00000100:00100000:3.0:1788832868.479514:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994299904 00000100:00100000:3.0:1788832868.479566:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788832868.479575:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:11701:x1875726994299904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832868.479807:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+18:11701:x1875726994299904:12345-0@lo:502:llog_process_th.0 Request processed in 233us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832868.479814:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788832868.484505:0:11701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:11701:1875726994299904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788832868.484553:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832868.484562:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832868.484565:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788832868.484570:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788832868.484907:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788832868.484930:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788832868.484941:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832868.484953:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832868.484964:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788832868.484967:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d2a26c800 from 7 10000000:01000000:2.0:1788832868.484969:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788832868.485002:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832868.485011:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832868.485021:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832868.485041:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994300032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832868.485109:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832868.485171:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994300032 00000100:00100000:2.0:1788832868.485175:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18143300 going to sleep for 11 seconds 00000100:00100000:3.0:1788832868.485179:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994300032 00000100:00100000:3.0:1788832868.485227:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788832868.485236:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+18:5850:x1875726994300032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832868.485248:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832868.485261:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3ada3200/0xd270a10c1c6a4d78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a4d71 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832868.485298:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3ada3200/0xd270a10c1c6a4d78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a4d71 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832868.485309:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3ada3200/0xd270a10c1c6a4d78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a4d71 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832868.485319:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3200, rc 0) 00000100:00100000:3.0:1788832868.485375:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994300032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832868.485381:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788832868.485516:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994300032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832868.485529:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832868.485538:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832868.485584:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994300160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832868.485611:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832868.485635:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d067570c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832868.486198:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994300160 00000100:00100000:2.0:1788832868.486204:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994300160 00000100:00100000:2.0:1788832868.486232:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788832868.486239:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994300160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832868.488296:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994300160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2047us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832868.488309:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788832868.489391:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994300160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832868.489440:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994300288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832868.489496:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832868.489533:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d067570c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832868.489622:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994300288 00000100:00100000:2.0:1788832868.489628:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994300288 00000100:00100000:2.0:1788832868.489668:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788832868.489676:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994300288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832868.489883:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:5850:x1875726994300288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832868.489891:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788832868.489972:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3989c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd32c45e-9a6a-4349-b87e-107522b34816:5850:1875726994300288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832868.490659:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:11703:1875726994300416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832868.490710:0:11703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832868.490757:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d04c69a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832868.490818:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994300416 00000100:00100000:1.0:1788832868.490828:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994300416 00000100:00100000:1.0:1788832868.490862:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788832868.490868:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:11703:x1875726994300416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832868.491003:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:11703:x1875726994300416:12345-0@lo:502:llog_process_th.0 Request processed in 134us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832868.491009:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788832868.492251:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:11703:1875726994300416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788832868.492293:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832868.492304:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832868.492307:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788832868.492315:0:11703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984d2a26c800 00000020:00000080:0.0:1788832868.492337:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788832868.492417:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:11703:1875726994300544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832868.492468:0:11703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832868.492499:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994300544 00000100:00100000:0.0:1788832868.492505:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994300544 00000100:00100000:0.0:1788832868.492533:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788832868.492540:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+20:11703:x1875726994300544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832868.492707:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+20:11703:x1875726994300544:12345-0@lo:502:llog_process_th.0 Request processed in 167us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832868.492714:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788832868.492762:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d37306600 going to sleep for 11 seconds 00000100:00100000:0.0:1788832868.492785:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd32c45e-9a6a-4349-b87e-107522b34816:11703:1875726994300544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788832868.492802:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832868.492806:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832868.492808:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788832868.492811:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788832868.493991:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788832868.494042:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788832868.494052:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832868.494063:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788832868.495802:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788832868.949941:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788832869.526417:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788832869.974118:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832871.001339:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832871.574668:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994301056:0@lo:400:kworker.0 00000100:00100000:1.0:1788832871.574732:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832871.574827:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788832871.574833:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994300672:0@lo:400:kworker.0 00000100:00100000:1.0:1788832871.574859:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832871.574877:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994301184:0@lo:400:kworker.0 00000100:00100000:1.0:1788832871.574895:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832871.574916:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994300928:0@lo:400:kworker.0 00000100:00100000:1.0:1788832871.574946:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832871.574960:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788832871.574964:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994300800:0@lo:400:kworker.0 00000100:00100000:1.0:1788832871.574982:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832871.574994:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994301312:0@lo:400:kworker.0 00000100:00100000:1.0:1788832871.575009:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832871.575044:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994301056 00000100:00100000:1.0:1788832871.575051:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994301056 00000100:00100000:1.0:1788832871.575092:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994301312 00000100:00100000:1.0:1788832871.575095:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994301312 00000100:00100000:1.0:1788832871.575112:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788832871.575119:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994301056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832871.575171:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994301056:12345-0@lo:400:kworker.0 Request processed in 52us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832871.575178:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788832871.575192:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788832871.575197:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1875726994301312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832871.575222:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1875726994301312:12345-0@lo:400:kworker.0 Request processed in 25us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832871.575227:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788832871.575240:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832871.575243:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832871.575269:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994301312:0@lo:400:kworker.0 00010000:00080000:1.0:1788832871.575294:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b946680 x1875726994301056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832871.575303:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994301056:0@lo:400:kworker.0 00000100:00100000:3.0:1788832871.575662:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994301184 00000100:00100000:3.0:1788832871.575666:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994301184 00000100:00100000:3.0:1788832871.575726:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994300928 00000100:00100000:3.0:1788832871.575730:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994300928 00000100:00100000:3.0:1788832871.575740:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994300800 00000100:00100000:3.0:1788832871.575768:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994300800 00000100:00100000:3.0:1788832871.575792:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788832871.575798:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994301184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832871.575838:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994301184:12345-0@lo:400:kworker.0 Request processed in 39us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832871.575844:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788832871.575858:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788832871.575864:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994300928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832871.575891:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994300928:12345-0@lo:400:kworker.0 Request processed in 28us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832871.575904:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788832871.575915:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788832871.575937:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994300800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832871.575965:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994300800:12345-0@lo:400:kworker.0 Request processed in 44us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832871.575970:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788832871.576291:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832871.576301:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994301440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832871.576333:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832871.576387:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994300672 00000100:00100000:0.0:1788832871.576392:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994300672 00000100:00100000:0.0:1788832871.576432:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788832871.576439:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994300672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832871.576473:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994300672:12345-0@lo:400:kworker.0 Request processed in 34us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832871.576478:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788832871.579076:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994301440 00000100:00100000:3.0:1788832871.579090:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994301440 00000100:00100000:3.0:1788832871.579155:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788832871.579165:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875726994301440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832871.579198:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832871.579286:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875726994301440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (2950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832871.579292:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788832871.579609:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832871.579648:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994300800:0@lo:400:kworker.0 00000100:00100000:1.0:1788832871.579661:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994300928:0@lo:400:kworker.0 00000100:00100000:1.0:1788832871.579697:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994300672:0@lo:400:kworker.0 00000100:00100000:1.0:1788832871.579709:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994301184:0@lo:400:kworker.0 00000100:00100000:0.0:1788832871.581168:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994301440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832871.773891:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832871.773931:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832871.773966:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832871.774066:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975392896 00000100:00100000:3.0:1788832871.774075:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975392896 00000100:00100000:3.0:1788832871.774133:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975393152 00000100:00100000:3.0:1788832871.774136:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975393152 00000100:00100000:3.0:1788832871.774158:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 109 00000100:00100000:3.0:1788832871.774167:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975392896:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832871.774244:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975392896:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 78us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832871.774252:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 109 00000100:00100000:3.0:1788832871.774266:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 110 00000100:00100000:3.0:1788832871.774272:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975393152:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832871.774311:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975393152:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 39us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832871.774317:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 110 00000100:00080000:3.0:1788832871.774445:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832871.775326:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832871.775577:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975393024 00000100:00100000:0.0:1788832871.775584:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975393024 00000100:00100000:0.0:1788832871.775640:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 51 00000100:00100000:0.0:1788832871.775649:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2359:x1875726975393024:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832871.775705:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2359:x1875726975393024:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 57us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832871.775711:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 51 00000100:00080000:3.0:1788832871.778008:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832871.781337:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975392768 00000100:00100000:1.0:1788832871.781351:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975392768 00000100:00100000:1.0:1788832871.781416:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 277 00000100:00100000:1.0:1788832871.781426:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975392768:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832871.781523:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975392768:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 98us (7555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832871.781530:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 277 00010000:00010000:0.0:1788832872.022880:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788832872.156009:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1788832873.046000:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832873.110624:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788832873.110646:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994301568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832873.110710:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832873.110819:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994301568 00000100:00100000:3.0:1788832873.110827:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994301568 00000100:00100000:3.0:1788832873.110877:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788832873.110887:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994301568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832873.110920:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832873.110961:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994301568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832873.110967:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788832873.110987:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788832873.111020:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d06478700 x1875726994301568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832873.111038:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994301568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788832874.070206:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832875.093953:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832876.117977:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832876.693987:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832876.694008:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994302080:0@lo:400:kworker.0 00000100:00100000:1.0:1788832876.694021:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994301952:0@lo:400:kworker.0 00000100:00100000:2.0:1788832876.694077:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994302208:0@lo:400:kworker.0 00000100:00100000:3.0:1788832876.694126:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994301824:0@lo:400:kworker.0 00000100:00100000:1.0:1788832876.699668:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832876.700468:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994302464:0@lo:400:kworker.0 00000100:00100000:1.0:1788832876.700585:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832876.700667:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994302464 00000100:00100000:1.0:1788832876.700674:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994302464 00000100:00100000:1.0:1788832876.701025:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788832876.701037:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994302464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832876.701096:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994302464:12345-0@lo:400:kworker.0 Request processed in 62us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832876.701104:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788832876.701125:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832876.701149:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788832876.701154:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984d3ac91500, transno 4294967300 00000100:00100000:1.0:1788832876.701167:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994302464:0@lo:400:kworker.0 00000100:00100000:0.0:1788832876.702813:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832876.702881:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994301696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832876.702921:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832876.702962:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994301696 00000100:00100000:0.0:1788832876.702968:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994301696 00000100:00100000:0.0:1788832876.703009:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788832876.703017:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994301696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832876.703044:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832876.703048:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994301952 00000100:00100000:1.0:1788832876.703052:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994301952 00000100:00100000:1.0:1788832876.703079:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994302080 00000100:00100000:1.0:1788832876.703082:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994302080 00000100:00100000:0.0:1788832876.703083:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994301696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832876.703090:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788832876.703106:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788832876.703112:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994301952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832876.703124:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788832876.703130:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994302080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832876.703153:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994301952:12345-0@lo:400:kworker.0 Request processed in 41us (3492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832876.703154:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994302080:12345-0@lo:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832876.703169:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788832876.703178:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1788832876.703190:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832876.703204:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994302080:0@lo:400:kworker.0 00000100:00100000:1.0:1788832876.703206:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994301952:0@lo:400:kworker.0 00000100:00100000:0.0:1788832876.703219:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994301696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832876.704550:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832876.705033:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994302208 00000100:00100000:0.0:1788832876.705041:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994302208 00000100:00100000:0.0:1788832876.705115:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788832876.705124:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994302208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832876.705177:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994302208:12345-0@lo:400:kworker.0 Request processed in 55us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832876.705184:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788832876.705311:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788832876.705338:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3ace7800 x1875726994302208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832876.705351:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994302208:0@lo:400:kworker.0 00000100:00100000:3.0:1788832876.708843:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832876.708908:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994302336:0@lo:400:kworker.0 00000100:00100000:3.0:1788832876.708953:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832876.709252:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994301824 00000100:00100000:1.0:1788832876.709260:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994301824 00000100:00100000:1.0:1788832876.709315:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788832876.709324:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994301824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832876.709382:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994301824:12345-0@lo:400:kworker.0 Request processed in 59us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832876.709390:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788832876.709514:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994302336 00000100:00100000:0.0:1788832876.709518:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994302336 00000100:00100000:0.0:1788832876.709576:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788832876.709584:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994302336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832876.709694:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994302336:12345-0@lo:400:kworker.0 Request processed in 103us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832876.709701:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1788832876.710084:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832876.710255:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994301824:0@lo:400:kworker.0 00000100:00100000:3.0:1788832876.710268:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994302336:0@lo:400:kworker.0 00000100:00100000:3.0:1788832876.891240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832876.891282:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832876.891321:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832876.891356:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832876.891387:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975393536 00000100:00100000:3.0:1788832876.891397:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975393536 00000100:00100000:3.0:1788832876.891473:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 54 00000100:00100000:3.0:1788832876.891483:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975393536:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832876.891550:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975393536:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 69us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832876.891558:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 54 00000100:00080000:3.0:1788832876.891660:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832876.891803:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975393408 00000100:00100000:1.0:1788832876.891807:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975393408 00000100:00100000:1.0:1788832876.891844:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975393664 00000100:00100000:1.0:1788832876.891847:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975393664 00000100:00100000:1.0:1788832876.891869:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 114 00000100:00100000:1.0:1788832876.891877:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975393408:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832876.891914:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975393408:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 39us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832876.891921:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 114 00000100:00100000:1.0:1788832876.891932:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 115 00000100:00100000:1.0:1788832876.891939:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975393664:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832876.891963:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975393664:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 24us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832876.891969:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 115 00000100:00080000:1.0:1788832876.892059:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832876.892185:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975393280 00000100:00100000:2.0:1788832876.892190:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975393280 00000100:00100000:2.0:1788832876.892226:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 279 00000100:00100000:2.0:1788832876.892233:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2360:x1875726975393280:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832876.892268:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2360:x1875726975393280:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 36us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832876.892274:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 279 00010000:00010000:1.0:1788832877.142710:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832878.165920:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832878.231555:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832878.231578:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994302592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832878.231642:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832878.233593:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994302592 00000100:00100000:1.0:1788832878.233606:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994302592 00000100:00100000:1.0:1788832878.233683:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788832878.233694:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994302592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832878.233735:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832878.233832:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994302592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832878.233839:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788832878.233903:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788832878.233979:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b365c00 x1875726994302592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832878.233999:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994302592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788832879.189955:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788832879.766480:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788832880.214382:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832881.238407:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832881.814260:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994302720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832881.814343:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832881.814565:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994302976:0@lo:400:kworker.0 00000100:00100000:1.0:1788832881.814596:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832881.814618:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788832881.814624:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994302848:0@lo:400:kworker.0 00000100:00100000:1.0:1788832881.814731:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832881.814771:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994303360:0@lo:400:kworker.0 00000100:00100000:1.0:1788832881.814797:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832881.814824:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994302976 00000100:00100000:1.0:1788832881.814831:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994302976 00000100:00100000:1.0:1788832881.814872:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994303360 00000100:00100000:1.0:1788832881.814875:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994303360 00000100:00100000:1.0:1788832881.814905:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788832881.814914:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994302976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832881.814960:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994302976:12345-0@lo:400:kworker.0 Request processed in 47us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832881.814978:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788832881.814995:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788832881.815010:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994303360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832881.815041:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994303360:12345-0@lo:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832881.815047:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1788832881.815072:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832881.815096:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994303360:0@lo:400:kworker.0 00000100:00100000:1.0:1788832881.815105:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994302976:0@lo:400:kworker.0 00000100:00100000:3.0:1788832881.815259:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994303104:0@lo:400:kworker.0 00000100:00100000:3.0:1788832881.815288:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832881.815305:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832881.815311:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994303232:0@lo:400:kworker.0 00000100:00100000:3.0:1788832881.815334:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832881.815483:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994303232 00000100:00100000:0.0:1788832881.815488:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994303232 00000100:00100000:0.0:1788832881.815529:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788832881.815537:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994303232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832881.815578:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994303232:12345-0@lo:400:kworker.0 Request processed in 43us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832881.815583:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788832881.815622:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b366d80 x1875726994303232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832881.815633:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994303232:0@lo:400:kworker.0 00000100:00100000:0.0:1788832881.815731:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994302720 00000100:00100000:0.0:1788832881.815762:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994302720 00000100:00100000:0.0:1788832881.815790:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788832881.815798:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994302720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832881.815822:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832881.815854:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994302720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832881.815860:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788832881.815941:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994302848 00000100:00100000:2.0:1788832881.815946:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994302848 00000100:00100000:2.0:1788832881.815986:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788832881.815993:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994302848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832881.816027:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994302848:12345-0@lo:400:kworker.0 Request processed in 34us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832881.816033:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788832881.816070:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994302720:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788832881.816179:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832881.816183:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832881.817070:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994302848:0@lo:400:kworker.0 00000100:00100000:1.0:1788832881.817094:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994303104 00000100:00100000:1.0:1788832881.817098:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994303104 00000100:00100000:1.0:1788832881.817148:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788832881.817156:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994303104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832881.817207:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994303104:12345-0@lo:400:kworker.0 Request processed in 52us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832881.817214:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788832881.817299:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994303104:0@lo:400:kworker.0 00000100:00080000:3.0:1788832881.817358:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832882.012741:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832882.012813:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832882.012987:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975393920 00000100:00100000:0.0:1788832882.012996:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975393920 00000100:00100000:0.0:1788832882.013068:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 119 00000100:00100000:0.0:1788832882.013079:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2359:x1875726975393920:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832882.013141:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2359:x1875726975393920:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 65us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832882.013149:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 119 00000100:00080000:3.0:1788832882.013334:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832882.013635:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975393792 00000100:00100000:1.0:1788832882.013640:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975393792 00000100:00100000:1.0:1788832882.013678:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 281 00000100:00100000:1.0:1788832882.013686:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975393792:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832882.013735:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975393792:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 49us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832882.013741:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 281 00000100:00100000:2.0:1788832882.036622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832882.036720:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975394176 00000100:00100000:1.0:1788832882.036730:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975394176 00000100:00100000:1.0:1788832882.036823:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 120 00000100:00100000:1.0:1788832882.036845:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975394176:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832882.036921:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975394176:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 78us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832882.036929:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 120 00000100:00080000:3.0:1788832882.037349:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832882.040054:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832882.040151:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975394048 00000100:00100000:3.0:1788832882.040160:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975394048 00000100:00100000:3.0:1788832882.040274:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 19 00000100:00100000:3.0:1788832882.040285:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2356:x1875726975394048:12345-192.168.206.41@tcp:9:kworker.0 00000020:00000080:3.0:1788832882.040311:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4cb4 00000100:00080000:3.0:1788832882.040331:0:6698:0:(import.c:65:import_set_state_nolock()) ffff984c054da800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788832882.040370:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788832882.040653:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+2:2356:x1875726975394048:12345-192.168.206.41@tcp:9:kworker.0 Request processed in 369us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832882.040661:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 19 00010000:00010000:2.0:1788832882.040912:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788832882.041663:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788832882.262067:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788832882.395043:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bee6676f-b533-4465-8162-bf8b5e1e90e6 00000020:00000080:1.0:1788832882.395052:0:7651:0:(genops.c:885:class_export_put()) final put ffff984c054df800/bee6676f-b533-4465-8162-bf8b5e1e90e6 00000020:00000080:2.0:1788832882.395165:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984c054df800/bee6676f-b533-4465-8162-bf8b5e1e90e6 for lustre-OST0001 00000020:00000080:2.0:1788832882.407842:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984c054da800 for lustre-OST0001 00010000:00010000:0.0:1788832883.286176:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832883.350847:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994303488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832883.350925:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832883.351022:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994303488 00000100:00100000:1.0:1788832883.351029:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994303488 00000100:00100000:1.0:1788832883.351079:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788832883.351088:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994303488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832883.351120:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832883.351163:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994303488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832883.351170:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788832883.351537:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788832883.352300:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3ace4700 x1875726994303488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832883.352320:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994303488:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788832884.316470:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832885.334600:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832886.358078:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832886.933891:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832886.933910:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994303616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832886.933984:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832886.934007:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994303616 00000100:00100000:1.0:1788832886.934016:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994303616 00000100:00100000:1.0:1788832886.934077:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788832886.934083:0:6701:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788832886.934093:0:6701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788832886.934098:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994303616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832886.934130:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832886.934179:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994303616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832886.934196:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788832886.934203:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832886.934259:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994303616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832886.934822:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994303872:0@lo:400:kworker.0 00000100:00100000:1.0:1788832886.935017:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994303744:0@lo:400:kworker.0 00000100:00100000:0.0:1788832886.935025:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832886.935053:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832886.935060:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994304000:0@lo:400:kworker.0 00000100:00100000:1.0:1788832886.935086:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832886.935103:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832886.935125:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994304256:0@lo:400:kworker.0 00000100:00100000:0.0:1788832886.935141:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994303872 00000100:00100000:0.0:1788832886.935147:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994303872 00000100:00100000:1.0:1788832886.935152:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832886.935173:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832886.935180:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994304128:0@lo:400:kworker.0 00000100:00100000:0.0:1788832886.935183:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994304000 00000100:00100000:0.0:1788832886.935188:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994304000 00000100:00100000:1.0:1788832886.935207:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832886.935212:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994304256 00000100:00100000:0.0:1788832886.935216:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994304256 00000100:00100000:0.0:1788832886.935239:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788832886.935240:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994303744 00000100:00100000:1.0:1788832886.935246:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994303744 00000100:00100000:0.0:1788832886.935250:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994303872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832886.935275:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788832886.935284:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994303744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832886.935303:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994303872:12345-0@lo:400:kworker.0 Request processed in 54us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832886.935324:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994303744:12345-0@lo:400:kworker.0 Request processed in 40us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832886.935331:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788832886.935373:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788832886.935380:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994304000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832886.935405:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994304000:12345-0@lo:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832886.935411:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788832886.935423:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788832886.935429:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994304256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832886.935452:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994304256:12345-0@lo:400:kworker.0 Request processed in 24us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832886.935464:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788832886.935481:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994304128 00000100:00100000:1.0:1788832886.935485:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994304128 00000100:00100000:1.0:1788832886.935634:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788832886.935644:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994304128:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788832886.935774:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832886.935791:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832886.936016:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994304128:12345-0@lo:400:kworker.0 Request processed in 373us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832886.936025:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788832886.936061:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3ac91880 x1875726994304128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832886.936076:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994304128:0@lo:400:kworker.0 00000100:00100000:0.0:1788832886.936090:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788832886.946289:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994303744:0@lo:400:kworker.0 00000100:00100000:1.0:1788832886.946311:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994304256:0@lo:400:kworker.0 00000100:00100000:2.0:1788832886.946517:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994304000:0@lo:400:kworker.0 00000100:00100000:2.0:1788832886.946535:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994303872:0@lo:400:kworker.0 00000100:00100000:0.0:1788832887.138138:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832887.138179:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832887.138213:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832887.138255:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975394560 00000100:00100000:1.0:1788832887.138266:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975394560 00000100:00100000:3.0:1788832887.138294:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975394304 00000100:00100000:3.0:1788832887.138300:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975394304 00000100:00100000:1.0:1788832887.138346:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975394432 00000100:00100000:3.0:1788832887.138352:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 283 00000100:00100000:1.0:1788832887.138353:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975394432 00000100:00100000:3.0:1788832887.138366:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2358:x1875726975394304:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832887.138388:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 124 00000100:00100000:1.0:1788832887.138399:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2358:x1875726975394560:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832887.138449:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2358:x1875726975394304:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 85us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832887.138462:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 283 00000100:00080000:0.0:1788832887.138484:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832887.138517:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 125 00000100:00100000:0.0:1788832887.138540:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975394432:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832887.139335:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2358:x1875726975394560:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 935us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832887.139344:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 124 00000100:00100000:0.0:1788832887.139426:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975394432:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 899us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832887.139433:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 125 00010000:00010000:2.0:1788832887.383864:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832888.409533:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832888.472279:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788832888.472301:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994304384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832888.472363:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832888.472524:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994304384 00000100:00100000:1.0:1788832888.472542:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994304384 00000100:00100000:1.0:1788832888.472606:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788832888.472615:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994304384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832888.472647:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832888.472713:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994304384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832888.472720:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788832888.472781:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b367800 x1875726994304384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832888.472800:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994304384:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788832888.473618:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788832889.429905:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788832890.006379:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788832890.459942:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788832890.558886:0:11866:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:01:29 (1788832889) 00010000:00010000:1.0:1788832891.478267:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832892.053946:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994304512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832892.054019:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832892.054159:0:11720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994304512 00000100:00100000:2.0:1788832892.054176:0:11720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994304512 00000100:00100000:2.0:1788832892.054236:0:11720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788832892.054252:0:11720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994304512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832892.054281:0:11720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832892.054330:0:11720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994304512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832892.054337:0:11720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788832892.054372:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994304512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832892.054607:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994304640:0@lo:400:kworker.0 00000100:00100000:2.0:1788832892.054659:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994304896:0@lo:400:kworker.0 00000100:00100000:0.0:1788832892.054667:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832892.054700:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832892.054712:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994305152:0@lo:400:kworker.0 00000100:00100000:2.0:1788832892.054727:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832892.054736:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994305024:0@lo:400:kworker.0 00000100:00100000:0.0:1788832892.054775:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832892.054789:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832892.054796:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832892.054804:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994304768:0@lo:400:kworker.0 00000100:00100000:2.0:1788832892.054827:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994304640 00000100:00100000:0.0:1788832892.054831:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832892.054833:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994304640 00000100:00100000:0.0:1788832892.054865:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994304896 00000100:00100000:2.0:1788832892.054870:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788832892.054870:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994304896 00000100:00100000:2.0:1788832892.054881:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994304640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832892.054911:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994305152 00000100:00100000:0.0:1788832892.054915:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994305152 00000100:00100000:2.0:1788832892.054924:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994304640:12345-0@lo:400:kworker.0 Request processed in 44us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832892.054931:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788832892.054957:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994304768 00000100:00100000:2.0:1788832892.054962:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994304768 00000100:00100000:2.0:1788832892.054979:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788832892.054986:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994304896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832892.055020:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994304896:12345-0@lo:400:kworker.0 Request processed in 35us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832892.055035:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788832892.055049:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788832892.055055:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994304768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832892.055083:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994304768:12345-0@lo:400:kworker.0 Request processed in 28us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832892.055088:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788832892.055104:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994305024 00000100:00100000:2.0:1788832892.055108:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994305024 00000100:00100000:2.0:1788832892.055134:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788832892.055140:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994305024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832892.055165:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994305024:12345-0@lo:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832892.055171:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788832892.055213:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b944e00 x1875726994305024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832892.055224:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994305024:0@lo:400:kworker.0 00000100:00100000:2.0:1788832892.055232:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994304896:0@lo:400:kworker.0 00000100:00080000:3.0:1788832892.055556:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832892.055561:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788832892.055563:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832892.055591:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994304768:0@lo:400:kworker.0 00000100:00100000:3.0:1788832892.055612:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994304640:0@lo:400:kworker.0 00000100:00100000:0.0:1788832892.056369:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788832892.056378:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994305152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832892.056428:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994305152:12345-0@lo:400:kworker.0 Request processed in 51us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832892.056435:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788832892.057605:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832892.058558:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994305152:0@lo:400:kworker.0 00000100:00100000:0.0:1788832892.254219:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832892.254318:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832892.254353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832892.254391:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975394688 00000100:00100000:1.0:1788832892.254400:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975394688 00000100:00100000:1.0:1788832892.254466:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 285 00000100:00100000:1.0:1788832892.254475:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975394688:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832892.254538:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975394816 00000100:00100000:1.0:1788832892.254539:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975394688:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 65us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832892.254542:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975394816 00000100:00100000:1.0:1788832892.254545:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 285 00000100:00100000:2.0:1788832892.254580:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975394944 00000100:00100000:2.0:1788832892.254583:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975394944 00000100:00100000:2.0:1788832892.254603:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 129 00000100:00100000:2.0:1788832892.254609:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2359:x1875726975394816:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832892.254660:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2359:x1875726975394816:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 50us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832892.254678:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 129 00000100:00100000:2.0:1788832892.254693:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 130 00000100:00100000:2.0:1788832892.254699:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2359:x1875726975394944:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832892.254733:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2359:x1875726975394944:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 34us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832892.254913:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 130 00000100:00080000:1.0:1788832892.254930:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788832892.503917:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832892.830479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832892.830718:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975395072 00000100:00100000:1.0:1788832892.830729:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975395072 00000100:00100000:1.0:1788832892.830812:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 32 00000100:00100000:1.0:1788832892.830823:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:10271:x1875726975395072:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832892.830865:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832892.830889:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4d7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55405 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.830948:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4d86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.830961:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.830972:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832892.831005:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788832892.831009:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788832892.831042:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.831067:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4d7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55405 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.831085:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4d86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55405 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.831094:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d02d42600) 00010000:00010000:1.0:1788832892.831097:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832892.831100:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05800, rc 0) 00000100:00100000:1.0:1788832892.831164:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:10271:x1875726975395072:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 344us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832892.831180:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 32 00000100:00100000:2.0:1788832892.846850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832892.846957:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975395200 00000100:00100000:1.0:1788832892.846967:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975395200 00000100:00100000:1.0:1788832892.847023:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 33 00000100:00100000:1.0:1788832892.847035:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:10272:x1875726975395200:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832892.847053:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832892.847073:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4d8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5540c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847132:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4d94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847146:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4d94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847156:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4d94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847170:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4d9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847177:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4d9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847183:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4d9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847586:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a4da2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847606:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a4da2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847613:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a4da2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832892.847651:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788832892.847655:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788832892.847672:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a4da2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847681:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4d94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847687:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4d94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847694:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4d94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847700:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832892.847705:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4d94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847711:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4d94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847723:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d02d42600) 00010000:00010000:1.0:1788832892.847725:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832892.847730:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4d94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847777:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4d94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847791:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4d9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847796:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4d9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847802:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4d9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847808:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832892.847811:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4d9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847817:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4d9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847824:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff984d02d42200) 00010000:00010000:1.0:1788832892.847827:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832892.847831:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4d9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847836:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4d9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847867:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4d8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5540c expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847879:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a4da2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5540c expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.847892:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff984d02d42c00) 00010000:00010000:1.0:1788832892.847894:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832892.847896:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04600, rc 0) 00000100:00100000:1.0:1788832892.847961:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:10272:x1875726975395200:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 928us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832892.847968:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 33 00000100:00100000:0.0:1788832892.855784:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832892.860184:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975395456 00000100:00100000:1.0:1788832892.860199:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975395456 00000100:00100000:1.0:1788832892.860269:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 34 00000100:00100000:1.0:1788832892.860279:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:10272:x1875726975395456:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832892.860298:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832892.860317:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4da9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55413 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.862624:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4db0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.862653:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4db0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.862665:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4db0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.862713:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4db7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.862720:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4db7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.862739:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4db7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865298:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04200/0xd270a10c1c6a4dbe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865317:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04200/0xd270a10c1c6a4dbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865327:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04200/0xd270a10c1c6a4dbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832892.865338:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788832892.865505:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4db0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865513:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4db0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865519:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4db0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865524:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832892.865528:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4db0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865535:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4db0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865546:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff984d02d42c00) 00010000:00010000:1.0:1788832892.865548:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832892.865559:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4db0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865565:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4db0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865578:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4db7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865584:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4db7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865590:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4db7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865594:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832892.865598:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4db7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865603:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4db7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865610:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff984d02d42200) 00010000:00010000:1.0:1788832892.865612:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832892.865615:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4db7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.865620:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4db7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.873926:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4da9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55413 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.873969:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04200/0xd270a10c1c6a4dbe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55413 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832892.873979:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d02d42000) 00010000:00010000:1.0:1788832892.873982:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832892.873985:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04200, rc 0) 00000100:00100000:1.0:1788832892.874060:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:10272:x1875726975395456:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 13781us (18284us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788832892.874070:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 34 00000100:00100000:0.0:1788832892.885138:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832892.885351:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975395584 00000100:00100000:3.0:1788832892.885360:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975395584 00000100:00100000:3.0:1788832892.885414:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 35 00000100:00100000:3.0:1788832892.885424:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:10272:x1875726975395584:12345-192.168.206.41@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788832892.885524:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:10272:x1875726975395584:12345-192.168.206.41@tcp:59:lhsmtool_posix.0 Request processed in 100us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832892.885531:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 35 00000040:00080000:1.0:1788832893.079370:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788832893.534853:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832893.589886:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832893.589907:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994305280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832893.589972:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832893.590037:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994305280 00000100:00100000:1.0:1788832893.590044:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994305280 00000100:00100000:1.0:1788832893.590087:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788832893.590096:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994305280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832893.590128:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832893.590170:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994305280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832893.590177:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788832893.590214:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3b365c00 x1875726994305280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832893.590239:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994305280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788832894.558276:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832895.055023:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832895.055166:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975395712 00000100:00100000:0.0:1788832895.055176:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975395712 00000100:00100000:0.0:1788832895.055344:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 36 00000100:00100000:0.0:1788832895.055355:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:10315:x1875726975395712:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788832895.055374:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832895.055400:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4dcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5541a expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055455:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4dd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055467:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055477:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055490:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4dda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055496:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4dda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055501:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4dda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055693:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055702:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4dd3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055708:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055714:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207e600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832895.055718:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055734:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4dd3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055767:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d02d42600) 00010000:00010000:0.0:1788832895.055770:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832895.055775:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4dd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055781:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4dd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055795:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4dda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055801:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4dda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055806:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4dda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055811:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207fc00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832895.055814:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4dda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055819:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4dda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055825:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff984d03c60a00) 00010000:00010000:0.0:1788832895.055828:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832895.055830:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4dda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055845:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4dda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055880:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4dcc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5541a expref: 10 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.055889:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d02d42600) 00010000:00010000:0.0:1788832895.055892:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832895.056100:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4dcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5541a expref: 10 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.056113:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d4207f600, rc 0) 00000100:00100000:0.0:1788832895.056167:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:10315:x1875726975395712:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 814us (1152us total) trans 0 rc 301/301 00000100:00100000:0.0:1788832895.056175:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 36 00000100:00080000:3.0:1788832895.058057:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832895.063595:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832895.063789:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975395968 00000100:00100000:1.0:1788832895.063799:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975395968 00000100:00100000:1.0:1788832895.063851:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 37 00000100:00100000:1.0:1788832895.063861:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:10315:x1875726975395968:12345-192.168.206.41@tcp:36:lfs.0 00010000:00010000:1.0:1788832895.064061:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832895.064087:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4d86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55405 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.064104:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d02d42600) 00010000:00010000:1.0:1788832895.064113:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832895.064299:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4de1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.064313:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4de1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.064323:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4de1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.064336:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4de8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.064344:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4de8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.064351:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4de8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832895.067292:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788832895.067309:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4de1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.067331:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4de1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.067338:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4de1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.067344:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832895.067348:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4de1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.067355:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4de1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.067370:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832895.067373:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832895.067378:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4de1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.067384:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4de1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832895.067401:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065e86870 reply state 00000000203addd7 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4de8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832895.067409:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832895.067517:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:10315:x1875726975395968:12345-192.168.206.41@tcp:36:lfs.0 Request processed in 3654us (3928us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788832895.067526:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 37 00010000:00010000:0.0:1788832895.070968:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4de8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.070985:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4de8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.070993:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4de8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.070999:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832895.071004:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4de8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.071012:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4de8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.071034:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff984d02d42200) 00010000:00010000:0.0:1788832895.071037:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832895.071043:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4de8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.071049:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4de8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832895.166298:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832895.166571:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975396096 00000100:00100000:0.0:1788832895.166580:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975396096 00000100:00100000:0.0:1788832895.166645:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 38 00000100:00100000:0.0:1788832895.166655:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:10323:x1875726975396096:12345-192.168.206.41@tcp:101:lctl.0 00010000:00010000:0.0:1788832895.166679:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832895.166700:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4def lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55421 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.166791:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4df6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.166805:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4df6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.166815:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4df6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832895.166846:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788832895.166850:0:7174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788832895.166883:0:7174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4df6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.166932:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4def lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55421 expref: 11 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.166954:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4df6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55421 expref: 10 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.166962:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60a00) 00010000:00010000:0.0:1788832895.166965:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832895.166969:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d4207fc00, rc 0) 00000100:00100000:0.0:1788832895.167019:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:10323:x1875726975396096:12345-192.168.206.41@tcp:101:lctl.0 Request processed in 365us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832895.167026:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 38 00000100:00100000:0.0:1788832895.230224:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832895.230384:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975396224 00000100:00100000:1.0:1788832895.230393:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975396224 00000100:00100000:1.0:1788832895.230472:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 39 00000100:00100000:1.0:1788832895.230481:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:10329:x1875726975396224:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:1.0:1788832895.230500:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832895.230518:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4dfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55428 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230575:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4e04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230589:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4e04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230599:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4e04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230613:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4e0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230619:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4e0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230624:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4e0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230732:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4e12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230740:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4e12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230773:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4e12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832895.230807:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788832895.230811:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788832895.230845:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4e12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230856:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4e04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230862:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4e04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230868:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4e04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230873:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832895.230877:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4e04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230884:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4e04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230896:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60a00) 00010000:00010000:1.0:1788832895.230899:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832895.230903:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4e04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230909:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4e04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230922:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4e0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230938:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4e0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230944:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4e0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230949:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832895.230953:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4e0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230958:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4e0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230966:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff984d02d42500) 00010000:00010000:1.0:1788832895.230968:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832895.230971:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4e0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.230977:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4e0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.231005:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4dfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55428 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.231017:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4e12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55428 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.231023:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:1.0:1788832895.231025:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788832895.231035:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04000, rc 0) 00000100:00100000:1.0:1788832895.231145:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:10329:x1875726975396224:12345-192.168.206.41@tcp:101:bash.0 Request processed in 664us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832895.231153:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 39 00000100:00100000:3.0:1788832895.239417:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832895.239564:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975396480 00000100:00100000:0.0:1788832895.239574:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975396480 00000100:00100000:0.0:1788832895.239642:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 40 00000100:00100000:0.0:1788832895.239652:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:10329:x1875726975396480:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:0.0:1788832895.239671:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832895.239689:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4e19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5542f expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.239837:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4e20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.239851:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4e20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.239879:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4e20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.239900:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a4e27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.239907:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a4e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.239914:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a4e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788832895.240383:0:7174:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788832895.240537:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4e2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.240547:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.240554:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.240584:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4e20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.240591:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4e20 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.240598:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4e20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.240603:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207e600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832895.240614:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4e20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.240622:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4e20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.240644:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:0.0:1788832895.240647:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832895.240652:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4e20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.240659:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a4e20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832895.240676:0:7174:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4c9c92c reply state 000000000acfdcfe transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a4e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832895.240684:0:7174:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788832895.240712:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a4e19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5542f expref: 14 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.240730:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5542f expref: 13 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.240737:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60000) 00010000:00010000:0.0:1788832895.240740:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832895.240776:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d4207f200, rc 0) 00000100:00100000:0.0:1788832895.240844:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:10329:x1875726975396480:12345-192.168.206.41@tcp:101:bash.0 Request processed in 1193us (1435us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788832895.240851:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 40 00010000:00010000:1.0:1788832895.245901:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a4e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.245918:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a4e27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.245926:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a4e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.245932:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207e200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832895.245937:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a4e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.245945:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a4e27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.245961:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d03c60d00) 00010000:00010000:1.0:1788832895.245964:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832895.245968:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a4e27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.245974:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a4e27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832895.246977:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.247134:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975396608 00000100:00100000:2.0:1788832895.247143:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975396608 00000100:00100000:2.0:1788832895.247176:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 20 00000100:00100000:2.0:1788832895.247183:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1875726975396608:12345-192.168.206.41@tcp:8:bash.0 00010000:00080000:2.0:1788832895.247209:0:8475:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:2.0:1788832895.247246:0:8475:0:(genops.c:1385:class_connect()) connect: client bee6676f-b533-4465-8162-bf8b5e1e90e6, cookie 0xd270a10c1c6a4e3c 00002000:00100000:2.0:1788832895.247256:0:8475:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bee6676f-b533-4465-8162-bf8b5e1e90e6/ffff984d3a166800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788832895.247265:0:8475:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788832895.247459:0:8475:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788832895.247485:0:8475:0:(import.c:65:import_set_state_nolock()) ffff984d3a163800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832895.247544:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2356:x1875726975396608:12345-192.168.206.41@tcp:8:bash.0 Request processed in 359us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832895.247551:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 20 00000100:00100000:3.0:1788832895.257087:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.257216:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975396736 00000100:00100000:2.0:1788832895.257225:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975396736 00000100:00100000:2.0:1788832895.257293:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 21 00000100:00100000:2.0:1788832895.257303:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:0:x1875726975396736:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:2.0:1788832895.257332:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832895.257354:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55436 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788832895.257380:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788832895.257396:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=398s v=(0 0) 00010000:00010000:2.0:1788832895.257400:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832895.257408:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55436 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.257427:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55436 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.257440:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703600, rc 0) 00000100:00100000:2.0:1788832895.257501:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:0:x1875726975396736:12345-192.168.206.41@tcp:101:bash.0 Request processed in 200us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832895.257508:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 21 00000100:00080000:3.0:1788832895.257591:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832895.260838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.261666:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975396864 00000100:00100000:2.0:1788832895.261675:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975396864 00000100:00100000:2.0:1788832895.261732:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 22 00000100:00100000:2.0:1788832895.261771:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:10329:x1875726975396864:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:2.0:1788832895.261787:0:8475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832895.261804:0:8475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5543d expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.261833:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55436 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.261855:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832895.261859:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832895.261865:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 8 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.261907:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55436 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.261924:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55436 expref: 8 pid: 6698 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832895.261937:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8475:1875726994305408:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832895.262021:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3b1d6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788832895.264461:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8475:1875726994305408:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832895.264501:0:8475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 8 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.264521:0:8475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702c00, rc 0) 00000100:00100000:2.0:1788832895.264585:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:10329:x1875726975396864:12345-192.168.206.41@tcp:101:bash.0 Request processed in 2845us (3754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832895.264594:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 22 00000100:00100000:3.0:1788832895.265704:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.266639:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975396992 00000100:00100000:2.0:1788832895.266648:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975396992 00010000:00010000:2.0:1788832895.266683:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55436 expref: 8 pid: 6698 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832895.266736:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 35 00000100:00100000:2.0:1788832895.266768:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2357:x1875726975396992:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832895.266782:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832895.266803:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55436 expref: 8 pid: 6698 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.266816:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55436 expref: 8 pid: 6698 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.266835:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55436 expref: 8 pid: 6698 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.266849:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832895.266852:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832895.266859:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.266868:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.266916:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832895.266928:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b944e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5839:1875726994305536:192.168.206.41@tcp:105: 00000100:00100000:2.0:1788832895.267008:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3b1d6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788832895.271945:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b944e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5839:1875726994305536:192.168.206.41@tcp:105: 00010000:00010000:2.0:1788832895.271976:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832895.272031:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975396992:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 5286us (6331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832895.272041:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 35 00000100:00100000:3.0:1788832895.274158:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.274943:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975397248 00000100:00100000:2.0:1788832895.274954:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975397248 00000100:00100000:2.0:1788832895.275081:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:2.0:1788832895.275092:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:10329:x1875726975397248:12345-192.168.206.41@tcp:35:bash.0 00000100:00100000:2.0:1788832895.275430:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:10329:x1875726975397248:12345-192.168.206.41@tcp:35:bash.0 Request processed in 339us (1277us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788832895.275438:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:1.0:1788832895.367430:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832895.367520:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975397504 00000100:00100000:3.0:1788832895.367529:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975397504 00000100:00100000:3.0:1788832895.367586:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 41 00000100:00100000:3.0:1788832895.367597:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:10339:x1875726975397504:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:3.0:1788832895.367619:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832895.367659:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4e51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55444 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832895.367739:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788832895.367891:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4e51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55444 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.367905:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60a00) 00010000:00010000:3.0:1788832895.367908:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832895.367913:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4e51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55444 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.367943:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2600, rc 0) 00000100:00100000:3.0:1788832895.367998:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:10339:x1875726975397504:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 404us (576us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788832895.368004:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 41 00000100:00100000:3.0:1788832895.378836:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.379061:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975397760 00000100:00100000:2.0:1788832895.379072:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975397760 00000100:00100000:2.0:1788832895.379172:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:2.0:1788832895.379183:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:10339:x1875726975397760:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:2.0:1788832895.379396:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:10339:x1875726975397760:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 214us (568us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788832895.379403:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:0.0:1788832895.457997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.458891:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975397888 00000100:00100000:2.0:1788832895.458902:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975397888 00000100:00100000:3.0:1788832895.459029:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 42 00000100:00100000:3.0:1788832895.459046:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:10345:x1875726975397888:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:3.0:1788832895.459069:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832895.459100:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4e5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5544b expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.459166:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4e66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.459180:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.459210:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832895.459242:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788832895.459246:0:7174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788832895.459262:0:7174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.459289:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4e5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5544b expref: 18 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.459306:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5544b expref: 17 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.459314:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:3.0:1788832895.459317:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832895.459321:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2400, rc 0) 00000100:00100000:3.0:1788832895.459383:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:10345:x1875726975397888:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 343us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832895.459389:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 42 00000100:00100000:1.0:1788832895.464057:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832895.464184:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975398144 00000100:00100000:3.0:1788832895.464194:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975398144 00000100:00100000:3.0:1788832895.464251:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 43 00000100:00100000:3.0:1788832895.464261:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:10345:x1875726975398144:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:3.0:1788832895.464282:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832895.464300:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a4e6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55452 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.464425:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.464440:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.464452:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832895.464462:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788832895.464591:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a4e6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55452 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.464608:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55452 expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.464617:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60000) 00010000:00010000:3.0:1788832895.464620:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832895.464624:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3400, rc 0) 00000100:00100000:3.0:1788832895.464695:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:10345:x1875726975398144:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 435us (648us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788832895.464703:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 43 00000100:00100000:0.0:1788832895.468857:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832895.468936:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975398400 00000100:00100000:1.0:1788832895.468955:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975398400 00000100:00100000:1.0:1788832895.469030:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 44 00000100:00100000:1.0:1788832895.469039:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:10345:x1875726975398400:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832895.469061:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832895.469079:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4e82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55459 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.469157:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4e89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.469169:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4e89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.469179:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4e89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832895.469189:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788832895.469294:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4e82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55459 expref: 22 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.469311:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4e89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55459 expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.469318:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60000) 00010000:00010000:1.0:1788832895.469320:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788832895.469324:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05400, rc 0) 00000100:00100000:1.0:1788832895.469388:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:10345:x1875726975398400:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 350us (539us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788832895.469406:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 44 00000100:00100000:0.0:1788832895.479260:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832895.479304:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832895.479419:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975398528 00000100:00100000:3.0:1788832895.479429:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975398528 00000100:00100000:3.0:1788832895.479493:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 2 00000100:00100000:3.0:1788832895.479503:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:2359:x1875726975398528:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832895.479517:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832895.479549:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55452 expref: 21 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.479566:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60000) 00010000:00010000:3.0:1788832895.479689:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832895.479732:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:2359:x1875726975398528:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 230us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832895.479740:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 2 00000100:00100000:2.0:1788832895.481625:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975398656 00000100:00100000:2.0:1788832895.481645:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975398656 00000100:00100000:2.0:1788832895.481693:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 23 00000100:00100000:2.0:1788832895.481702:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975398656:12345-192.168.206.41@tcp:1:lfs.0 00010000:00010000:2.0:1788832895.481772:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.481791:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.481800:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788832895.481804:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832895.481808:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.481843:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.481856:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 7 pid: 8475 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832895.481869:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875726994305664:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832895.481962:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3b1d6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832895.489366:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.489471:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875726994305664:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832895.489506:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832895.489596:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975398784 00000100:00100000:1.0:1788832895.489602:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975398784 00002000:00100000:1.0:1788832895.489652:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff984d3a7cd180 x1875726975398784/t0(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:81/0 lens 504/0 e 0 to 0 dl 1788832906 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832895.489663:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3a7cd180 with x1875726975398784 ext(0->12) 00010000:00010000:1.0:1788832895.489670:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 8 pid: 8475 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.489685:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 8 pid: 8475 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788832895.489692:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff984d3a7cd180 00000100:00100000:1.0:1788832895.489725:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00100000:1.0:1788832895.489735:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2358:x1875726975398784:12345-192.168.206.41@tcp:4:lfs.0 00000001:00100000:3.0:1788832895.517396:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bee6676f-b533-4465-8162-bf8b5e1e90e6 00000001:00080000:0.0:1788832895.552809:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1788832895.552971:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975398784:12345-192.168.206.41@tcp:4:lfs.0 Request processed in 63231us (63607us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788832895.552983:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 0 00002000:00100000:1.0:1788832895.552995:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff984d3a7cd180 x1875726975398784/t4294967299(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:81/0 lens 504/448 e 0 to 0 dl 1788832906 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832895.553005:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3a7cd180 with x1875726975398784 ext(0->12) 00010000:00010000:1.0:1788832895.553015:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 7 pid: 8475 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.553034:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 7 pid: 8475 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788832895.553058:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff984d3a7cd180 00000100:00100000:1.0:1788832895.561993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832895.562088:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975398912 00000100:00100000:3.0:1788832895.562098:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975398912 00010000:00010000:3.0:1788832895.562134:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 7 pid: 8475 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832895.562178:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 36 00000100:00100000:3.0:1788832895.562188:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975398912:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832895.562201:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788832895.562219:0:5838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788832895.562222:0:5838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788832895 00002000:00010000:3.0:1788832895.562224:0:5838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788832895 00002000:00010000:3.0:1788832895.562226:0:5838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788832895 00002000:00010000:3.0:1788832895.562228:0:5838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788832895.562234:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 7 pid: 8475 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.562247:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 7 pid: 8475 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.562292:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a4e4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5543d expref: 7 pid: 8475 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.562322:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832895.562327:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832895.562334:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.562343:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.562377:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832895.562431:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975398912:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 244us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832895.562441:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 36 00010000:00010000:0.0:1788832895.562447:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.562461:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.562487:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.562496:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.562504:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.562511:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:0.0:1788832895.562515:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.562524:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.562550:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832895.562558:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a4e97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832895.562604:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975398656:12345-192.168.206.41@tcp:1:lfs.0 Request processed in 80902us (83299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832895.562612:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 23 00000100:00100000:0.0:1788832895.566061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832895.566133:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975399168 00000100:00100000:3.0:1788832895.566144:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975399168 00000100:00100000:3.0:1788832895.566195:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:3.0:1788832895.566204:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:10345:x1875726975399168:12345-192.168.206.41@tcp:35:lfs.0 00000004:00010000:3.0:1788832895.566262:0:5856:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4e89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55459 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788832895.566543:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788832895.566808:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788832895.567284:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788832895.567342:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.567363:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4e2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5542f expref: 24 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.567372:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.567404:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5542f expref: 24 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.567418:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4e2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5542f expref: 24 pid: 7174 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832895.567432:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5856:1875726994305792:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832895.567531:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06ba3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832895.571408:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5856:1875726994305792:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832895.571434:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832895.572287:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832895.573092:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975399296 00000100:00100000:3.0:1788832895.573102:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975399296 00010000:00010000:3.0:1788832895.573135:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4e2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5542f expref: 25 pid: 7174 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832895.573163:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 37 00000100:00100000:3.0:1788832895.573170:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+25:2357:x1875726975399296:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832895.573184:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832895.573200:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4e2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5542f expref: 25 pid: 7174 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.573211:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5542f expref: 25 pid: 7174 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.573231:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a4e2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5542f expref: 25 pid: 7174 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.573251:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60000) 00010000:00010000:3.0:1788832895.573256:0:7639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.573264:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.573271:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.573301:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832895.573364:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+24:2357:x1875726975399296:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 194us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832895.573371:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 37 00010000:00010000:2.0:1788832895.574291:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832895.575986:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.576001:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788832895.576117:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788832895.576320:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788832895.576446:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9be680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5856:1875726994305920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788832895.576508:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832895.576549:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06de3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788832895.577457:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994305920 00000100:00100000:2.0:1788832895.577468:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994305920 00000100:00080000:3.0:1788832895.578685:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832895.583843:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832895.583862:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5856:x1875726994305920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788832895.583988:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5856:x1875726994305920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 134us (7478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832895.583995:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832895.584167:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9be680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5856:1875726994305920:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788832895.585028:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788832895.585105:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9be680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5856:1875726994306048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788832895.585155:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832895.585184:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06de3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788832895.585264:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994306048 00000100:00100000:3.0:1788832895.585272:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994306048 00000100:00100000:3.0:1788832895.585322:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832895.585330:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5856:x1875726994306048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788832895.585543:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5856:x1875726994306048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 213us (388us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788832895.585570:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832895.585787:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9be680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5856:1875726994306048:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788832895.585843:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788832895.585879:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.585890:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.585971:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.585987:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832895.585992:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.585999:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.586015:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60000) 00010000:00010000:1.0:1788832895.586017:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788832895.586022:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832895.586028:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a4e9e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788832895.586194:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788832895.586402:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788832895.586412:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399276667975ns, next at 400276666105ns, rc = 0 00000001:00080000:1.0:1788832895.586418:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788832895.586447:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60000) 00010000:00010000:1.0:1788832895.586450:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788832895.586456:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a4e89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55459 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832895.587439:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+27:10345:x1875726975399168:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 21231us (21383us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788832895.587455:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 8 00000020:00080000:1.0:1788832895.587461:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788832895.597695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832895.598271:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975399424 00000100:00100000:3.0:1788832895.598282:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975399424 00000100:00100000:3.0:1788832895.598329:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 45 00000100:00100000:3.0:1788832895.598338:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+27:10345:x1875726975399424:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:3.0:1788832895.598361:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832895.598382:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a4ea5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55460 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.598438:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a4ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55460 expref: 28 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.598451:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a4ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55460 expref: 28 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.598468:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:3.0:1788832895.598472:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832895.598475:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2c00, rc 0) 00000100:00100000:3.0:1788832895.598774:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+28:10345:x1875726975399424:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 435us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832895.598780:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 45 00000100:00100000:0.0:1788832895.603902:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.603994:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975399680 00000100:00100000:2.0:1788832895.604004:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975399680 00000100:00100000:2.0:1788832895.604055:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:2.0:1788832895.604065:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d18422050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+28:10345:x1875726975399680:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:2.0:1788832895.604277:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d18422050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+29:10345:x1875726975399680:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 212us (395us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788832895.604285:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:1.0:1788832895.762608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832895.762706:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975399936 00000100:00100000:3.0:1788832895.762715:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975399936 00000100:00100000:3.0:1788832895.762830:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 46 00000100:00100000:3.0:1788832895.762839:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+29:10355:x1875726975399936:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:3.0:1788832895.762861:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832895.762880:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4eac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55467 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832895.762973:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788832895.763098:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4eac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55467 expref: 31 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.763112:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60a00) 00010000:00010000:3.0:1788832895.763115:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832895.763120:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4eac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55467 expref: 31 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832895.763133:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2600, rc 0) 00000100:00100000:3.0:1788832895.763181:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+30:10355:x1875726975399936:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 343us (583us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788832895.763188:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 46 00000100:00100000:0.0:1788832895.771106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.772042:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975400064 00000100:00100000:2.0:1788832895.772052:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975400064 00000100:00100000:2.0:1788832895.772268:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 47 00000100:00100000:2.0:1788832895.772279:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+30:10355:x1875726975400064:12345-192.168.206.41@tcp:34:lfs.0 00010000:00010000:2.0:1788832895.772359:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4eba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772374:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4eba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772386:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4eba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772402:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772409:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772415:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772530:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4ec8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772552:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772571:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788832895.772611:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772622:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4eba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772639:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4eba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772645:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4eba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772651:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832895.772655:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4eba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772663:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4eba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772674:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:2.0:1788832895.772678:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832895.772682:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4eba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772688:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4eba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772708:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772714:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772720:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772726:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832895.772729:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772735:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772799:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d0c2cf300) 00010000:00010000:2.0:1788832895.772802:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832895.772805:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ec1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772812:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ec1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772826:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772833:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4ec8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772840:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772853:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832895.772856:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772862:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4ec8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772870:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:2.0:1788832895.772873:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832895.772876:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4ec8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.772882:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4ec8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832895.772962:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+30:10355:x1875726975400064:12345-192.168.206.41@tcp:34:lfs.0 Request processed in 684us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832895.772970:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 47 00000100:00100000:0.0:1788832895.776423:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.777146:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975400320 00000100:00100000:2.0:1788832895.777156:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975400320 00000100:00100000:2.0:1788832895.777213:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00100000:2.0:1788832895.777222:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+30:10355:x1875726975400320:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:2.0:1788832895.777471:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+31:10355:x1875726975400320:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 249us (1055us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788832895.777479:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00100000:1.0:1788832895.842239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.842398:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975400576 00000100:00100000:2.0:1788832895.842407:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975400576 00000100:00100000:2.0:1788832895.842473:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 48 00000100:00100000:2.0:1788832895.842510:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+31:10359:x1875726975400576:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832895.842533:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832895.842553:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4ecf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5546e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.842646:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ed6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.842661:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.842672:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.842684:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4edd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.842690:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.842695:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843046:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a4ee4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843056:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a4ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843063:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a4ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832895.843215:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788832895.843309:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843317:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ed6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843324:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843331:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832895.843335:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843342:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ed6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843354:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:2.0:1788832895.843357:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832895.843361:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ed6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843368:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a4ed6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843380:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843386:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4edd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843404:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4edd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843409:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832895.843412:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4edd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843417:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4edd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843425:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d0c2cf300) 00010000:00010000:2.0:1788832895.843427:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832895.843429:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4edd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843434:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4edd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843492:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4ecf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5546e expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843506:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a4ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5546e expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.843512:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:2.0:1788832895.843514:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832895.843516:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703000, rc 0) 00000100:00100000:2.0:1788832895.845150:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+33:10359:x1875726975400576:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 2637us (2912us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788832895.845175:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 48 00000100:00100000:0.0:1788832895.848419:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.848730:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975400704 00000100:00100000:2.0:1788832895.848740:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975400704 00000100:00100000:2.0:1788832895.849211:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 49 00000100:00100000:2.0:1788832895.849223:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+33:10359:x1875726975400704:12345-192.168.206.41@tcp:54:lfs.0 00010000:00010000:2.0:1788832895.849286:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4ef2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.849302:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.849314:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.849338:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.849344:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.849350:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.849356:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832895.849360:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.849367:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.849378:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:2.0:1788832895.849390:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832895.849396:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4ef2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832895.849402:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4ef2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832895.852418:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+33:10359:x1875726975400704:12345-192.168.206.41@tcp:54:lfs.0 Request processed in 3187us (3996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832895.852432:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 49 00000100:00100000:1.0:1788832895.864890:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832895.865071:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975400960 00000100:00100000:2.0:1788832895.865083:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975400960 00000100:00100000:2.0:1788832895.865194:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:2.0:1788832895.865207:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+33:10359:x1875726975400960:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:2.0:1788832895.865516:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+34:10359:x1875726975400960:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 310us (712us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788832895.865526:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:1.0:1788832896.087008:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832896.087145:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975401216 00000100:00100000:3.0:1788832896.087158:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975401216 00000100:00100000:3.0:1788832896.087281:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 50 00000100:00100000:3.0:1788832896.087293:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+34:10390:x1875726975401216:12345-192.168.206.41@tcp:101:cat.0 00010000:00010000:3.0:1788832896.087324:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832896.087352:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4ef9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55475 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.087515:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4f00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.087533:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.087547:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832896.087561:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788832896.087805:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4ef9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55475 expref: 37 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.087832:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4f00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55475 expref: 36 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.087843:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:3.0:1788832896.087847:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832896.087850:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3600, rc 0) 00000100:00100000:3.0:1788832896.087982:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+36:10390:x1875726975401216:12345-192.168.206.41@tcp:101:cat.0 Request processed in 690us (988us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788832896.087990:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 50 00000100:00100000:0.0:1788832896.091294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832896.091549:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975401472 00000100:00100000:1.0:1788832896.091634:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975401472 00000100:00100000:1.0:1788832896.091718:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:1.0:1788832896.091731:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+36:10390:x1875726975401472:12345-192.168.206.41@tcp:35:cat.0 00000100:00100000:1.0:1788832896.093153:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+37:10390:x1875726975401472:12345-192.168.206.41@tcp:35:cat.0 Request processed in 1415us (2063us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788832896.093168:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:2.0:1788832896.093388:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832896.093985:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975401600 00000100:00100000:1.0:1788832896.093996:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975401600 00000100:00100000:1.0:1788832896.094070:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 3 00000100:00100000:1.0:1788832896.094081:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+37:2358:x1875726975401600:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832896.094097:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832896.094127:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a4f00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55475 expref: 37 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.094149:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832896.094160:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832896.094199:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+36:2358:x1875726975401600:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 120us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832896.094206:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 3 00000100:00100000:0.0:1788832896.128581:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832896.128655:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975401856 00000100:00100000:3.0:1788832896.128667:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975401856 00000100:00100000:3.0:1788832896.128797:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 51 00000100:00100000:3.0:1788832896.128809:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+36:10396:x1875726975401856:12345-192.168.206.41@tcp:101:dd.0 00010000:00010000:3.0:1788832896.128843:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832896.128870:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788832896.128904:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4e66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5544b expref: 36 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.128928:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:3.0:1788832896.128934:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832896.128950:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4f0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5547c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.129087:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.129100:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a4ee4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5546e expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.129106:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.129141:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a4ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5546e expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.129152:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a4ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5546e expref: 36 pid: 5854 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832896.129163:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994306176:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832896.129280:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06ba30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832896.133019:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994306176:192.168.206.41@tcp:104: 00000100:00100000:0.0:1788832896.133043:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00010000:00010000:3.0:1788832896.133055:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832896.133997:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975401984 00000100:00100000:1.0:1788832896.134013:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975401984 00010000:00010000:1.0:1788832896.134070:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a4ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5546e expref: 37 pid: 5854 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832896.134139:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 38 00000100:00100000:1.0:1788832896.134150:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+37:2358:x1875726975401984:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832896.134171:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832896.134180:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a4ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5546e expref: 37 pid: 5854 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.134195:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a4ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5546e expref: 37 pid: 5854 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.134222:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a4ee4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5546e expref: 37 pid: 5854 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.134242:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832896.134247:0:7639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.134258:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.134267:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.134449:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832896.134529:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+36:2358:x1875726975401984:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 380us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832896.134537:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 38 00010000:00010000:3.0:1788832896.134889:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.134899:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832896.134923:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788832896.135160:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4f0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5547c expref: 37 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.135178:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5547c expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.135187:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:3.0:1788832896.135191:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832896.135193:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2200, rc 0) 00000100:00100000:3.0:1788832896.135247:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+36:10396:x1875726975401856:12345-192.168.206.41@tcp:101:dd.0 Request processed in 6441us (6679us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788832896.135256:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 51 00000100:00100000:0.0:1788832896.138350:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832896.138691:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975402240 00000100:00100000:2.0:1788832896.138706:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975402240 00000100:00100000:2.0:1788832896.138948:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 52 00000100:00100000:2.0:1788832896.138961:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+36:10396:x1875726975402240:12345-192.168.206.41@tcp:36:dd.0 00010000:00010000:2.0:1788832896.139305:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.139326:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.139340:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832896.139414:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788832896.139447:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd3855d5 reply state 00000000580e462d transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832896.139457:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832896.139856:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+39:10396:x1875726975402240:12345-192.168.206.41@tcp:36:dd.0 Request processed in 896us (1519us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788832896.139865:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 52 00000020:00080000:2.0:1788832896.139882:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788832896.141913:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.141934:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.141943:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.141967:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832896.141974:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.141982:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.142005:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:0.0:1788832896.142008:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832896.142013:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.142020:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832896.360791:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832896.360937:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975402368 00000100:00100000:2.0:1788832896.360950:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975402368 00000100:00100000:2.0:1788832896.361027:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 53 00000100:00100000:2.0:1788832896.361040:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+38:10410:x1875726975402368:12345-192.168.206.41@tcp:101:stat.0 00010000:00010000:2.0:1788832896.361072:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832896.361099:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a4f2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55483 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.361368:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a4f31 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.361387:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a4f31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.361416:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a4f31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.361435:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a4f38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.361465:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a4f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.361473:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a4f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.361591:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.361605:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5547c expref: 39 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.361614:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f3f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.361669:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5547c expref: 39 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.361686:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5547c expref: 39 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832896.361703:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b944e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994306304:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832896.361878:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18143000 going to sleep for 11 seconds 00000100:00100000:1.0:1788832896.365290:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b944e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994306304:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832896.365357:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832896.365472:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832896.365807:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975402624 00000100:00100000:3.0:1788832896.365816:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975402624 00000100:00100000:3.0:1788832896.365898:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00100000:3.0:1788832896.365909:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+40:5595:x1875726975402624:12345-192.168.206.41@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788832896.366532:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+41:5595:x1875726975402624:12345-192.168.206.41@tcp:35:ldlm_bl.0 Request processed in 620us (1057us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788832896.367027:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00100000:0.0:1788832896.374352:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832896.374525:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975402752 00000100:00100000:1.0:1788832896.374538:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975402752 00010000:00010000:1.0:1788832896.374599:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5547c expref: 41 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832896.374658:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 39 00000100:00100000:1.0:1788832896.374670:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+41:2358:x1875726975402752:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832896.374689:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832896.374698:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5547c expref: 41 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.374713:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5547c expref: 41 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.374816:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a4f15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5547c expref: 41 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.374838:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832896.374844:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.374855:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.374865:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f3f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.374933:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832896.375006:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+40:2358:x1875726975402752:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 337us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832896.375014:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 39 00010000:00010000:2.0:1788832896.376081:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376102:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832896.376202:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788832896.376209:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788832896.376272:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376291:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376302:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a4f31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376309:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a4f31 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376316:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a4f31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376322:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832896.376327:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a4f31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376335:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a4f31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376353:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:2.0:1788832896.376357:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832896.376362:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a4f31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376369:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a4f31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376397:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a4f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376419:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a4f38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376425:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a4f38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376430:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832896.376434:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a4f38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376440:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a4f38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376449:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d0c2cf300) 00010000:00010000:2.0:1788832896.376452:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832896.376456:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a4f38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376462:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a4f38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376514:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a4f2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55483 expref: 40 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376530:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55483 expref: 39 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.376563:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:2.0:1788832896.376566:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832896.376568:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703c00, rc 0) 00000100:00100000:2.0:1788832896.376660:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+39:10410:x1875726975402368:12345-192.168.206.41@tcp:101:stat.0 Request processed in 15621us (15925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832896.376669:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 53 00000100:00100000:0.0:1788832896.480125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832896.480231:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975403008 00000100:00100000:3.0:1788832896.480240:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975403008 00000100:00100000:3.0:1788832896.480377:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 54 00000100:00100000:3.0:1788832896.480465:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+39:10416:x1875726975403008:12345-192.168.206.41@tcp:36:truncate.0 00010000:00010000:3.0:1788832896.480524:0:7174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832896.480550:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a4f3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55483 expref: 39 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.480580:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:3.0:1788832896.480585:0:7174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832896.480866:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4f46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.480880:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.480890:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788832896.480938:0:7174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788832896.480968:0:7174:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef7f2611 reply state 000000000631432d transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832896.480983:0:7174:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832896.481502:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+41:10416:x1875726975403008:12345-192.168.206.41@tcp:36:truncate.0 Request processed in 1113us (1383us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788832896.481510:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 54 00000020:00080000:2.0:1788832896.481515:0:7174:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788832896.483727:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.484190:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4f46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.484200:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4f46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.484206:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832896.484212:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4f46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.484220:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4f46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.484239:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832896.484242:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832896.484248:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4f46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.484254:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a4f46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.598075:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832896.669156:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832896.669289:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975403136 00000100:00100000:3.0:1788832896.669299:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975403136 00000100:00100000:3.0:1788832896.669361:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 55 00000100:00100000:3.0:1788832896.669372:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+40:10430:x1875726975403136:12345-192.168.206.41@tcp:101:stat.0 00010000:00010000:3.0:1788832896.669397:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832896.669418:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4f4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5548a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669495:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4f54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669509:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4f54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669520:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4f54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669534:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669540:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669546:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669649:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4f62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669657:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4f62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669664:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4f62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832896.669695:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788832896.669699:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788832896.669734:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4f62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669784:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4f62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669792:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4f54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669799:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4f54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669806:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4f54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669811:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832896.669815:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4f54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669822:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4f54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669833:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:3.0:1788832896.669836:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832896.669841:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4f54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669847:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4f54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669860:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669866:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669879:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669884:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832896.669887:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669893:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669902:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d113e9600) 00010000:00010000:3.0:1788832896.669904:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832896.669907:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669913:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669945:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4f4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5548a expref: 42 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669959:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4f62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5548a expref: 41 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.669966:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:3.0:1788832896.669968:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832896.669971:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3800, rc 0) 00000100:00100000:3.0:1788832896.670032:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+41:10430:x1875726975403136:12345-192.168.206.41@tcp:101:stat.0 Request processed in 662us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832896.670048:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 55 00000100:00100000:3.0:1788832896.779487:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832896.779595:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975403392 00000100:00100000:2.0:1788832896.779604:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975403392 00000100:00100000:2.0:1788832896.779691:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 56 00000100:00100000:2.0:1788832896.779701:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+41:10440:x1875726975403392:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832896.779721:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832896.779741:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a4f69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55491 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832896.779861:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788832896.779992:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a4f69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55491 expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.780007:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60a00) 00010000:00010000:2.0:1788832896.780010:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832896.780027:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a4f69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55491 expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.780042:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703e00, rc 0) 00000100:00100000:2.0:1788832896.780107:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+42:10440:x1875726975403392:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 407us (630us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788832896.780115:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 56 00000100:00100000:0.0:1788832896.783506:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832896.783600:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975403648 00000100:00100000:1.0:1788832896.783629:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975403648 00000100:00100000:1.0:1788832896.783695:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:1.0:1788832896.783707:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+42:10440:x1875726975403648:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:1.0:1788832896.784003:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+43:10440:x1875726975403648:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 297us (505us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788832896.784010:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:1.0:1788832896.873275:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832896.873396:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975403904 00000100:00100000:3.0:1788832896.873406:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975403904 00000100:00100000:3.0:1788832896.873464:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 57 00000100:00100000:3.0:1788832896.873475:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+43:10446:x1875726975403904:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:3.0:1788832896.873498:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832896.873516:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4f77 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55498 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.873640:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.873656:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4f62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5548a expref: 44 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.873665:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.873698:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4f62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5548a expref: 44 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.873712:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4f62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5548a expref: 44 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832896.873726:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994306432:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832896.873833:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06ba3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832896.878137:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994306432:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832896.878166:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832896.881999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832896.883169:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975404032 00000100:00100000:0.0:1788832896.883186:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975404032 00010000:00010000:0.0:1788832896.883246:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4f62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5548a expref: 45 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832896.883298:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 40 00000100:00100000:0.0:1788832896.883321:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+45:2357:x1875726975404032:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832896.883341:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832896.883362:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4f62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5548a expref: 45 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.883377:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4f62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5548a expref: 45 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.883404:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a4f62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5548a expref: 45 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.883423:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:0.0:1788832896.883428:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.883439:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.883447:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.883486:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832896.883575:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+44:2357:x1875726975404032:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 267us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832896.883585:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 40 00010000:00010000:3.0:1788832896.883805:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.883816:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832896.883841:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788832896.884129:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4f77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55498 expref: 45 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.884157:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55498 expref: 44 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.884166:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:3.0:1788832896.884169:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832896.884172:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3e00, rc 0) 00000100:00100000:3.0:1788832896.884222:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+44:10446:x1875726975403904:12345-192.168.206.41@tcp:101:bash.0 Request processed in 10749us (10955us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788832896.884229:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 57 00000100:00100000:1.0:1788832896.894842:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832896.894994:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975404288 00000100:00100000:2.0:1788832896.895015:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975404288 00000100:00100000:2.0:1788832896.895102:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 58 00000100:00100000:2.0:1788832896.895113:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+44:10446:x1875726975404288:12345-192.168.206.41@tcp:36:bash.0 00010000:00010000:2.0:1788832896.896730:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4f8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.896765:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4f8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.896778:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4f8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832896.896864:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788832896.896902:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1429848 reply state 00000000ae2c81eb transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4f8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832896.896911:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832896.897061:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+47:10446:x1875726975404288:12345-192.168.206.41@tcp:36:bash.0 Request processed in 1947us (2230us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788832896.897071:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 58 00000020:00080000:2.0:1788832896.897076:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788832896.905058:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4f8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.905076:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4f8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.905084:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4f8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.905109:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832896.905114:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4f8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.905121:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4f8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.905138:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:0.0:1788832896.905141:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832896.905145:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4f8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832896.905152:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a4f8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832896.909096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832896.909196:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975404416 00000100:00100000:2.0:1788832896.909237:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975404416 00000100:00100000:2.0:1788832896.909323:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 59 00000100:00100000:2.0:1788832896.909334:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+46:10446:x1875726975404416:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:2.0:1788832896.909358:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832896.909377:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4f93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5549f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.909456:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4f9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.909472:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55498 expref: 47 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.909480:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4f9a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.909513:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55498 expref: 47 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832896.909527:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55498 expref: 47 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832896.909539:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b946680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994306560:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832896.912316:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18143540 going to sleep for 11 seconds 00000100:00100000:2.0:1788832896.921120:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832896.924237:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975404544 00000100:00100000:3.0:1788832896.924259:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975404544 00010000:00010000:3.0:1788832896.924336:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55498 expref: 48 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832896.924393:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 41 00000100:00100000:3.0:1788832896.924423:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+48:2358:x1875726975404544:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832896.924443:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832896.924450:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55498 expref: 48 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.924467:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55498 expref: 48 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.924493:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:3.0:1788832896.924499:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4f9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.924511:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.924520:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4f9a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832896.924544:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832896.924649:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+48:2358:x1875726975404544:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 227us (3541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832896.924659:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 41 00010000:00010000:1.0:1788832896.929857:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4f7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55498 expref: 47 pid: 5855 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832896.929892:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b946680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994306560:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832896.929925:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.929939:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.929947:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832896.930454:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788832896.930463:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788832896.930495:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.930919:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a4f93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5549f expref: 47 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.930971:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4f9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5549f expref: 46 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832896.930983:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832896.930986:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832896.930990:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703800, rc 0) 00000100:00100000:1.0:1788832896.931492:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+46:10446:x1875726975404416:12345-192.168.206.41@tcp:101:bash.0 Request processed in 22155us (22406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832896.931504:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 59 00000100:00100000:2.0:1788832896.939030:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832896.939343:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975404800 00000100:00100000:1.0:1788832896.939355:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975404800 00000100:00100000:1.0:1788832896.939426:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:1.0:1788832896.939451:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d18421850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+46:10446:x1875726975404800:12345-192.168.206.41@tcp:35:bash.0 00000100:00100000:1.0:1788832896.939813:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d18421850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+47:10446:x1875726975404800:12345-192.168.206.41@tcp:35:bash.0 Request processed in 376us (796us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788832896.939822:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:2.0:1788832897.063592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832897.063733:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975405056 00000100:00100000:0.0:1788832897.063779:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975405056 00000100:00080000:3.0:1788832897.063977:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832897.064035:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 60 00000100:00100000:2.0:1788832897.064047:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+47:10456:x1875726975405056:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832897.064089:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832897.064108:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a4fa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b554a6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832897.064197:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788832897.064307:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a4fa1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554a6 expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832897.064322:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60a00) 00010000:00010000:2.0:1788832897.064325:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832897.064330:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a4fa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554a6 expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832897.064343:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702c00, rc 0) 00000100:00100000:2.0:1788832897.064402:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+48:10456:x1875726975405056:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 358us (830us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788832897.064422:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 60 00000100:00100000:0.0:1788832897.068300:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832897.074103:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975405184 00000100:00100000:3.0:1788832897.074117:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975405184 00000100:00100000:3.0:1788832897.074330:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 61 00000100:00100000:3.0:1788832897.074341:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+48:10456:x1875726975405184:12345-192.168.206.41@tcp:34:lfs.0 00010000:00010000:3.0:1788832897.074413:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4faf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074456:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4faf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074468:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4faf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074486:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4fb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074492:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074498:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074711:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4fbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074721:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074729:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788832897.074787:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074878:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4faf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074887:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4faf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074909:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4faf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074917:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832897.074922:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4faf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074929:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4faf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074940:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:3.0:1788832897.074943:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832897.074948:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4faf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074954:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a4faf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074966:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074972:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074978:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074982:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832897.074984:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.074999:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.075008:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d113e9600) 00010000:00010000:3.0:1788832897.075010:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832897.075013:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4fb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.075019:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a4fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.075036:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.075042:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4fbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.075047:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.075052:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832897.075055:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.075061:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4fbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.075067:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:3.0:1788832897.075069:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832897.075071:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4fbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832897.075085:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a4fbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832897.075165:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+48:10456:x1875726975405184:12345-192.168.206.41@tcp:34:lfs.0 Request processed in 824us (6871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832897.075173:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 61 00000100:00100000:3.0:1788832897.077500:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832897.077788:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975405440 00000100:00100000:2.0:1788832897.077798:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975405440 00000100:00100000:2.0:1788832897.077851:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:2.0:1788832897.077859:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+48:10456:x1875726975405440:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:2.0:1788832897.078165:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+49:10456:x1875726975405440:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 305us (673us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788832897.078174:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:2.0:1788832897.144412:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832897.144512:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975405696 00000100:00100000:1.0:1788832897.144522:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975405696 00000100:00100000:1.0:1788832897.144590:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 62 00000100:00100000:1.0:1788832897.144600:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+49:10459:x1875726975405696:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832897.144634:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832897.144663:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4fc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b554ad expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.144775:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4fcb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.144803:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.144815:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.144833:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4fd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.144840:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.144846:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.144973:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4fd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.144982:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.144989:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832897.144998:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788832897.145087:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145096:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4fcb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145103:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4fcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145115:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832897.145119:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4fcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145127:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4fcb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145140:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:1.0:1788832897.145143:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832897.145147:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4fcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145154:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a4fcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145168:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145174:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145181:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145186:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832897.145189:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145197:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145215:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d02d42500) 00010000:00010000:1.0:1788832897.145217:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832897.145221:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4fd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145227:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a4fd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145268:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a4fc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554ad expref: 52 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145281:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554ad expref: 51 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.145289:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832897.145291:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832897.145293:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05200, rc 0) 00000100:00100000:1.0:1788832897.145356:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+51:10459:x1875726975405696:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 757us (952us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788832897.145364:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 62 00000100:00100000:0.0:1788832897.149088:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832897.149216:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975405824 00000100:00100000:1.0:1788832897.149227:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975405824 00000100:00100000:1.0:1788832897.149293:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 63 00000100:00100000:1.0:1788832897.149306:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+51:10459:x1875726975405824:12345-192.168.206.41@tcp:54:lfs.0 00010000:00010000:1.0:1788832897.149371:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4fe7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.149386:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.149410:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.149434:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.149441:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4fe7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.149448:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.149453:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832897.149457:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.149464:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4fe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.149477:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832897.149480:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832897.149484:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4fe7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.149489:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4fe7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832897.149575:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+51:10459:x1875726975405824:12345-192.168.206.41@tcp:54:lfs.0 Request processed in 269us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832897.149582:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 63 00000100:00100000:3.0:1788832897.149946:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832897.151069:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975405952 00000100:00100000:1.0:1788832897.151089:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975405952 00000100:00100000:1.0:1788832897.151155:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 4 00000100:00100000:1.0:1788832897.151164:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+51:2357:x1875726975405952:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832897.151177:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832897.151196:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4fd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554ad expref: 51 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.151211:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832897.151216:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832897.151260:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+50:2357:x1875726975405952:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 97us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832897.151267:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 4 00000100:00100000:0.0:1788832897.158338:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832897.158595:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975406208 00000100:00100000:1.0:1788832897.158605:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975406208 00000100:00100000:1.0:1788832897.158690:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 17 00000100:00100000:1.0:1788832897.158700:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+50:10459:x1875726975406208:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:1.0:1788832897.158986:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+51:10459:x1875726975406208:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 286us (656us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788832897.158993:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 17 00000100:00100000:1.0:1788832897.174026:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994306944:0@lo:400:kworker.0 00000100:00100000:0.0:1788832897.174026:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994306816:0@lo:400:kworker.0 00000100:00100000:2.0:1788832897.174107:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994307072:0@lo:400:kworker.0 00000100:00100000:3.0:1788832897.174191:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994307200:0@lo:400:kworker.0 00000100:00100000:0.0:1788832897.175165:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832897.175166:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832897.175231:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994306688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832897.175241:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994307456:0@lo:400:kworker.0 00000100:00100000:2.0:1788832897.175254:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832897.175286:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832897.175296:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994306816 00000100:00100000:2.0:1788832897.175303:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994306816 00000100:00100000:0.0:1788832897.175303:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832897.175306:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832897.175313:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3fadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994307328:0@lo:400:kworker.0 00000100:00100000:2.0:1788832897.175351:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788832897.175362:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994306816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832897.175367:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994307456 00000100:00100000:0.0:1788832897.175372:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994307456 00000100:00100000:1.0:1788832897.175410:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832897.175435:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994306816:12345-0@lo:400:kworker.0 Request processed in 75us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832897.175441:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788832897.175446:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788832897.175448:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994306688 00000100:00100000:0.0:1788832897.175586:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994307456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832897.175601:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994306688 00000100:00100000:1.0:1788832897.175655:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788832897.175662:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1875726994307456:12345-0@lo:400:kworker.0 Request processed in 79us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832897.175667:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875726994306688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832897.175695:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832897.176010:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875726994306688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 347us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832897.176017:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788832897.176053:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994307456:0@lo:400:kworker.0 00000100:00100000:1.0:1788832897.176075:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994306944 00000100:00100000:1.0:1788832897.176078:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994306944 00000100:00100000:1.0:1788832897.176103:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994307072 00000100:00100000:1.0:1788832897.176106:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994307072 00000100:00100000:1.0:1788832897.176119:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994307328 00000100:00100000:1.0:1788832897.176122:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994307328 00000100:00100000:1.0:1788832897.176135:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788832897.176141:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994306944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832897.176176:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994306944:12345-0@lo:400:kworker.0 Request processed in 35us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832897.176181:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788832897.176202:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994306944:0@lo:400:kworker.0 00000100:00100000:1.0:1788832897.176219:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788832897.176225:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994307072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832897.176258:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994307072:12345-0@lo:400:kworker.0 Request processed in 34us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832897.176263:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788832897.176284:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994307072:0@lo:400:kworker.0 00000100:00100000:1.0:1788832897.176433:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788832897.176441:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3989c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994307328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832897.176787:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832897.176830:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994307200 00000100:00100000:3.0:1788832897.176834:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994307200 00000100:00100000:0.0:1788832897.176896:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788832897.176918:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994306816:0@lo:400:kworker.0 00000100:00100000:2.0:1788832897.176938:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994306688:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788832897.176945:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788832897.176950:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832897.176952:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832897.177015:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788832897.177023:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875726994307200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832897.177196:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875726994307200:12345-0@lo:400:kworker.0 Request processed in 172us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832897.177203:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788832897.177696:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3989c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994307328:12345-0@lo:400:kworker.0 Request processed in 1255us (2286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832897.177704:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788832897.177758:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994307200:0@lo:400:kworker.0 00000100:00100000:0.0:1788832897.177876:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3fadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994307328:0@lo:400:kworker.0 00000100:00100000:0.0:1788832897.325345:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832897.325494:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975406464 00000100:00100000:1.0:1788832897.325504:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975406464 00000100:00100000:1.0:1788832897.325574:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 64 00000100:00100000:1.0:1788832897.325584:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+51:10477:x1875726975406464:12345-192.168.206.41@tcp:101:cat.0 00010000:00010000:1.0:1788832897.325608:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832897.325639:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4fee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b554b4 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.325952:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4ff5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.325967:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.325981:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832897.325994:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788832897.326110:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a4fee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554b4 expref: 54 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.326128:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554b4 expref: 53 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.326153:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832897.326156:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788832897.326159:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04c00, rc 0) 00000100:00100000:1.0:1788832897.326223:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+53:10477:x1875726975406464:12345-192.168.206.41@tcp:101:cat.0 Request processed in 640us (886us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788832897.326231:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 64 00000100:00100000:3.0:1788832897.364804:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832897.365039:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975406592 00000100:00100000:0.0:1788832897.365048:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975406592 00000100:00100000:0.0:1788832897.365193:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 65 00000100:00100000:0.0:1788832897.365204:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+53:10478:x1875726975406592:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788832897.365227:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832897.365247:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a5003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b554bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.365311:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a500a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.365325:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a500a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.365336:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a500a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832897.365369:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788832897.365373:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788832897.365392:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a500a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.365444:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a5003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554bb expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.365468:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a500a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554bb expref: 54 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.365477:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:0.0:1788832897.365480:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832897.365483:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d4207e600, rc 0) 00000100:00100000:0.0:1788832897.365546:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:10478:x1875726975406592:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 344us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832897.365553:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 65 00000100:00100000:3.0:1788832897.385379:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832897.385481:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832897.385512:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832897.385575:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832897.385642:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975407232 00000100:00100000:3.0:1788832897.385652:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975407232 00000100:00100000:2.0:1788832897.385696:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975406976 00000100:00100000:2.0:1788832897.385701:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975406976 00000100:00100000:3.0:1788832897.385710:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 60 00000100:00100000:3.0:1788832897.385719:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975407232:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832897.385728:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 18 00000100:00100000:2.0:1788832897.385734:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:10478:x1875726975406976:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:3.0:1788832897.385833:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975407232:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832897.385840:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 60 00000100:00080000:3.0:1788832897.385860:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832897.386203:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975407104 00000100:00100000:0.0:1788832897.386218:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975407104 00000100:00100000:0.0:1788832897.386254:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 287 00000100:00100000:0.0:1788832897.386261:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d103bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2358:x1875726975407104:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832897.386296:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d103bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2358:x1875726975407104:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 35us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832897.386302:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 287 00000100:00100000:2.0:1788832897.386304:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:10478:x1875726975406976:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 570us (933us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788832897.386310:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 18 00000100:00100000:1.0:1788832897.386510:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975407360 00000100:00100000:1.0:1788832897.386514:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975407360 00000100:00100000:1.0:1788832897.386558:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 134 00000100:00100000:1.0:1788832897.386564:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2358:x1875726975407360:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832897.386591:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2358:x1875726975407360:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 27us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832897.386597:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 134 00000100:00080000:0.0:1788832897.386670:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832897.401282:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832897.401405:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975407488 00000100:00100000:0.0:1788832897.401420:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975407488 00000100:00100000:0.0:1788832897.401487:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 5 00000100:00100000:0.0:1788832897.401494:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:10478:x1875726975407488:12345-192.168.206.41@tcp:103:lfs.0 00010000:00010000:0.0:1788832897.401505:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788832897.401537:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a4f9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5549f expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.401554:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a4ff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554b4 expref: 54 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.401563:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a4ea5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55460 expref: 53 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.401570:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d113e9400) 00010000:00010000:0.0:1788832897.401582:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832897.401687:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:10478:x1875726975407488:12345-192.168.206.41@tcp:103:lfs.0 Request processed in 188us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832897.401694:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 5 00000100:00100000:2.0:1788832897.405847:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832897.406278:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975407616 00000100:00100000:1.0:1788832897.406293:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975407616 00000100:00100000:1.0:1788832897.406627:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 66 00000100:00100000:1.0:1788832897.406640:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:10478:x1875726975407616:12345-192.168.206.41@tcp:58:lfs.0 00010000:00010000:1.0:1788832897.411675:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5011 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.411704:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5011 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.411719:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5011 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788832897.412280:0:5855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832897.413811:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788832897.414000:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788832897.414283:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:10478:x1875726975407616:12345-192.168.206.41@tcp:58:lfs.0 Request processed in 7519us (8323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832897.414297:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 66 00000100:00100000:1.0:1788832897.465013:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832897.465080:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975407744 00000100:00100000:0.0:1788832897.465090:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975407744 00000100:00100000:0.0:1788832897.465152:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 67 00000100:00100000:0.0:1788832897.465161:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:10480:x1875726975407744:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788832897.465191:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832897.465213:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a5018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b554c2 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465287:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a501f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465302:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a501f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465314:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a501f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465341:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a5026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465361:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a5026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465368:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a5026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465466:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a502d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465474:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a502d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465481:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a502d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832897.465511:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788832897.465515:0:7174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788832897.465532:0:7174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a502d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465544:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a502d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465552:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a501f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465559:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a501f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465581:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a501f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465587:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207e200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832897.465591:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a501f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465597:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a501f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465609:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:0.0:1788832897.465611:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832897.465616:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a501f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465636:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e200/0xd270a10c1c6a501f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465654:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a5026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465660:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a5026 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465665:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a5026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465670:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207f200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832897.465673:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a5026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465687:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a5026 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465695:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d03c60700) 00010000:00010000:0.0:1788832897.465697:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832897.465700:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a5026 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465706:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f200/0xd270a10c1c6a5026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465816:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a5018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554c2 expref: 54 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465832:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a502d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554c2 expref: 53 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.465839:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d02d42500) 00010000:00010000:0.0:1788832897.465841:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832897.465843:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bb200, rc 0) 00000100:00100000:0.0:1788832897.465911:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+53:10480:x1875726975407744:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 751us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832897.465919:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 67 00010000:00010000:1.0:1788832897.623182:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788832897.720909:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967311 is committed 00000001:00080000:3.0:1788832897.720927:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:3.0:1788832897.720946:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788832897.720969:0:5875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984d06de3a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788832897.720974:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d3bd01d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984d06de3cc0 00000020:00080000:3.0:1788832897.720977:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d3bd01400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984d20426c00 00000001:00080000:3.0:1788832897.721002:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000020:00080000:3.0:1788832897.721060:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788832897.721168:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788832897.721333:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994307584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788832897.721542:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832897.721694:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994307584 00000100:00100000:1.0:1788832897.721701:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994307584 00000100:00100000:1.0:1788832897.721767:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788832897.721777:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875726994307584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788832897.721801:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1788832897.721831:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f6c7f, atime: 0x6a9f6c7f, ctime: 0x6a9f6c7f, blocks: 0xb 00010000:00010000:1.0:1788832897.721839:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e075e23b/0xd270a10c1c6a5034 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.721855:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=401s v=(0 0) 00010000:00010000:1.0:1788832897.721859:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832897.721866:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e075e23b/0xd270a10c1c6a5034 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.721883:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e075e23b/0xd270a10c1c6a5034 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.721893:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e075e23b/0xd270a10c1c6a5034 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.721913:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e075e23b/0xd270a10c1c6a5034 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832897.721930:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788832897.721943:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832897.721949:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e075e23b/0xd270a10c1c6a5034 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.721961:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:0.0:1788832897.721965:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e075e23b/0xd270a10c1c6a5034 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.721974:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e075e23b/0xd270a10c1c6a5034 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.721989:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e075e23b/0xd270a10c1c6a5034 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.721996:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e075e23b/0xd270a10c1c6a5034 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832897.722012:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832897.722013:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832897.722015:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832897.722812:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875726994307584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1034us (1267us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788832897.722820:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1788832897.724403:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984d398fad80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788832897.724414:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994307584:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1788832898.199020:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832898.199028:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832898.199077:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788832898.199085:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832898.199206:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3accca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875726994307712:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832898.199293:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c07b8c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788832898.213032:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832898.213084:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3accca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875726994307712:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788832898.213263:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975407872 00000100:00100000:1.0:1788832898.213270:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975407872 00000100:00100000:1.0:1788832898.213314:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 1 00000100:00100000:1.0:1788832898.213323:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:10491:x1875726975407872:12345-192.168.206.41@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788832898.213403:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:10491:x1875726975407872:12345-192.168.206.41@tcp:900:lhsmtool_posix.0 Request processed in 80us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832898.213410:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 1 00000100:00100000:3.0:1788832898.220444:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832898.226357:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975408000 00000100:00100000:2.0:1788832898.226371:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975408000 00000100:00100000:2.0:1788832898.226463:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 68 00000100:00100000:2.0:1788832898.226473:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:10491:x1875726975408000:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788832898.226500:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788832898.226612:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:10491:x1875726975408000:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 Request processed in 140us (6281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832898.226631:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 68 00000100:00100000:3.0:1788832898.233986:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832898.234096:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975408128 00000100:00100000:2.0:1788832898.234105:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975408128 00000100:00100000:2.0:1788832898.234156:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 69 00000100:00100000:2.0:1788832898.234167:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:10491:x1875726975408128:12345-192.168.206.41@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788832898.234231:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a503b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234246:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a503b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234256:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a503b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234272:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5042 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234278:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5042 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234285:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5042 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234309:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234328:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234336:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832898.234378:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788832898.234382:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788832898.234396:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234406:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a503b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234413:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a503b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234420:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a503b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234426:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832898.234430:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a503b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234437:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a503b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234449:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d02d42000) 00010000:00010000:2.0:1788832898.234453:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832898.234459:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a503b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234464:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a503b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234475:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5042 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234492:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5042 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234497:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5042 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234502:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832898.234506:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5042 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234512:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5042 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234519:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff984d0c2cf300) 00010000:00010000:2.0:1788832898.234522:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832898.234525:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5042 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234530:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5042 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234543:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234548:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5049 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234554:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234559:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832898.234567:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234573:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5049 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234579:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d02d42500) 00010000:00010000:2.0:1788832898.234582:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832898.234584:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5049 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.234589:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5049 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832898.234664:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:10491:x1875726975408128:12345-192.168.206.41@tcp:34:lhsmtool_posix.0 Request processed in 500us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832898.234671:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 69 00000100:00100000:1.0:1788832898.242713:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832898.242940:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975408384 00000100:00100000:3.0:1788832898.242949:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975408384 00000100:00100000:3.0:1788832898.243010:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 70 00000100:00100000:3.0:1788832898.243021:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:10491:x1875726975408384:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832898.243041:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832898.243059:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a5050 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b554c9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.243147:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5057 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.243172:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.243183:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832898.243195:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788832898.245031:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.245046:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5057 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.245053:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.245059:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832898.245063:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.245070:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5057 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.245084:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d02d42500) 00010000:00010000:3.0:1788832898.245087:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832898.245092:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5057 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.245098:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5057 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.245140:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a5050 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554c9 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.245158:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d02d42000) 00010000:00010000:3.0:1788832898.245161:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832898.245164:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a5050 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554c9 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.245173:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2000, rc 0) 00000040:00080000:0.0:1788832898.245969:0:12015:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832898.245980:0:12015:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832898.246021:0:12015:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788832898.246026:0:12015:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788832898.246681:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:10491:x1875726975408384:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 3656us (3970us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788832898.246691:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 70 00000100:00100000:0.0:1788832898.259844:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832898.260038:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975408512 00000100:00100000:2.0:1788832898.260048:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975408512 00000100:00100000:2.0:1788832898.260102:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 71 00000100:00100000:2.0:1788832898.260111:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3acced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:10491:x1875726975408512:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788832898.260139:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788832898.260412:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3acced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:10491:x1875726975408512:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 Request processed in 301us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832898.260420:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 71 00000100:00100000:2.0:1788832898.266547:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832898.266695:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975408768 00000100:00100000:3.0:1788832898.266705:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975408768 00000100:00100000:3.0:1788832898.266794:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 72 00000100:00100000:3.0:1788832898.266804:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:10491:x1875726975408768:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832898.266823:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832898.266826:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788832898.266857:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207e600/0xd270a10c1c6a500a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554bb expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.266881:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:3.0:1788832898.266887:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832898.266900:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5065 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b554d0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788832898.267592:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788832898.267871:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a506c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.267890:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a506c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.267900:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a506c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.267953:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5065 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554d0 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.267968:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a506c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554d0 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.267976:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff984d113e9600) 00010000:00010000:3.0:1788832898.267979:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832898.268109:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2000, rc 0) 00000100:00100000:3.0:1788832898.271377:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:10491:x1875726975408768:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 4564us (4827us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788832898.271389:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 72 00000100:00100000:2.0:1788832898.276378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832898.276512:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975409024 00000100:00100000:0.0:1788832898.276521:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975409024 00000100:00100000:0.0:1788832898.276574:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 73 00000100:00100000:0.0:1788832898.276583:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:10491:x1875726975409024:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788832898.276641:0:7174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832898.276664:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a506c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554d0 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.276682:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff984d113e9600) 00010000:00010000:0.0:1788832898.276694:0:7174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832898.276714:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a507a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.276728:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a507a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.276737:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a507a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.276941:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5081 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x4f694914 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.276950:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5081 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f694914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.276957:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5081 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f694914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277144:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a507a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277152:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a507a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277158:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a507a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277164:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832898.277167:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a507a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277174:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a507a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277183:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:0.0:1788832898.277185:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832898.277189:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a507a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277194:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a507a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277204:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5081 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f694914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277866:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5081 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f694914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277876:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5081 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f694914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277891:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036baa00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832898.277894:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5081 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f694914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277901:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5081 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f694914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277912:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x4f694914 (ffff984d03c60700) 00010000:00010000:0.0:1788832898.277915:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832898.277918:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5081 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4f694914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.277923:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5081 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4f694914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832898.278011:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:10491:x1875726975409024:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 1426us (1640us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788832898.278019:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 73 00000100:00100000:2.0:1788832898.282292:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832898.282402:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975409152 00000100:00100000:3.0:1788832898.282411:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975409152 00000100:00100000:3.0:1788832898.282480:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 74 00000100:00100000:3.0:1788832898.282490:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:10491:x1875726975409152:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832898.282508:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832898.282529:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5088 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b554d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.282562:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a508f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.282580:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a508f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.282591:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a508f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.282687:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554d7 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.282702:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a508f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554d7 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.282711:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff984d113e9400) 00010000:00010000:3.0:1788832898.282714:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788832898.282717:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3e00, rc 0) 00000100:00100000:2.0:1788832898.283042:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:10491:x1875726975409152:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 552us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832898.283056:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 74 00000100:00100000:0.0:1788832898.288101:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832898.291352:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975409408 00000100:00100000:1.0:1788832898.291364:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975409408 00000100:00100000:1.0:1788832898.291431:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 75 00000100:00100000:1.0:1788832898.291440:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:10491:x1875726975409408:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788832898.291512:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5096 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.291527:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.291549:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788832898.291984:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1788832898.291995:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 401982250507ns, next at 402982248286ns, rc = 0 00000004:00010000:1.0:1788832898.292075:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5da6aaf reply state 00000000167064f8 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832898.292085:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832898.292858:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:10491:x1875726975409408:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 1413us (4761us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788832898.292867:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 75 00010000:00010000:0.0:1788832898.318339:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.318356:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5096 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.318364:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5096 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.318371:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832898.318375:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5096 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.318390:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5096 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.318408:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff984d113e9400) 00010000:00010000:0.0:1788832898.318410:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788832898.318415:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5096 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.318422:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5096 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832898.325797:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832898.325986:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975409536 00000100:00100000:1.0:1788832898.325996:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975409536 00000100:00100000:1.0:1788832898.326051:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 76 00000100:00100000:1.0:1788832898.326062:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:10491:x1875726975409536:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832898.326084:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832898.326103:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a509d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b554de expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.326161:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a509d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554de expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.326176:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a509d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554de expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.326193:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832898.326207:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832898.326222:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05a00, rc 0) 00000100:00100000:1.0:1788832898.326272:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:10491:x1875726975409536:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 212us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832898.326278:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 76 00000100:00100000:3.0:1788832898.340092:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832898.340185:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975409664 00000100:00100000:0.0:1788832898.340195:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975409664 00000100:00100000:0.0:1788832898.340308:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 25 00000100:00100000:0.0:1788832898.340316:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1875726975409664:12345-192.168.206.41@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788832898.340348:0:8475:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:0.0:1788832898.340375:0:8475:0:(genops.c:1385:class_connect()) connect: client bee6676f-b533-4465-8162-bf8b5e1e90e6, cookie 0xd270a10c1c6a50a4 00002000:00100000:0.0:1788832898.340388:0:8475:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bee6676f-b533-4465-8162-bf8b5e1e90e6/ffff984d3a7b5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788832898.340409:0:8475:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788832898.340630:0:8475:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788832898.340658:0:8475:0:(import.c:65:import_set_state_nolock()) ffff984d3a7b7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788832898.340716:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2356:x1875726975409664:12345-192.168.206.41@tcp:8:lhsmtool_posix.0 Request processed in 399us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832898.340724:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 25 00000100:00100000:0.0:1788832898.355538:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832898.356229:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975409792 00000100:00100000:3.0:1788832898.356239:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975409792 00000100:00100000:3.0:1788832898.356307:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 26 00000100:00100000:3.0:1788832898.356317:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:0:x1875726975409792:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788832898.356574:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788832898.458026:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bee6676f-b533-4465-8162-bf8b5e1e90e6 00000001:00080000:1.0:1788832898.458043:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1788832898.458096:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:0:x1875726975409792:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 Request processed in 101776us (102562us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788832898.458106:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 26 00000100:00100000:0.0:1788832898.465740:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832898.467037:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975410048 00000100:00100000:2.0:1788832898.467051:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975410048 00000100:00100000:2.0:1788832898.467268:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 19 00000100:00100000:2.0:1788832898.467280:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:10491:x1875726975410048:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788832898.467491:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:10491:x1875726975410048:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 212us (1756us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788832898.467499:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 19 00000100:00100000:1.0:1788832898.473537:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832898.473610:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975410304 00000100:00100000:0.0:1788832898.473630:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975410304 00000100:00100000:0.0:1788832898.473691:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 77 00000100:00100000:0.0:1788832898.473702:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:10491:x1875726975410304:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788832898.473839:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:10491:x1875726975410304:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 139us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832898.473847:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 77 00000100:00100000:0.0:1788832898.476726:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832898.476933:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975410432 00000100:00100000:1.0:1788832898.476942:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975410432 00000100:00100000:1.0:1788832898.477538:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 78 00000100:00100000:1.0:1788832898.477552:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:10491:x1875726975410432:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832898.477571:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832898.477590:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a50ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b554e5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.478574:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.478592:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.478604:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832898.478653:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788832898.478672:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.478703:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a50ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554e5 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.478737:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554e5 expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.480174:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832898.480179:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788832898.480182:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05e00, rc 0) 00000100:00100000:1.0:1788832898.480340:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:10491:x1875726975410432:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 2789us (3620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832898.480350:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 78 00000100:00100000:2.0:1788832898.492218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832898.492357:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975410560 00000100:00100000:0.0:1788832898.492366:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975410560 00000100:00100000:0.0:1788832898.492466:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 27 00000100:00100000:0.0:1788832898.492477:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2357:x1875726975410560:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788832898.492492:0:8475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832898.492511:0:8475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a50b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b554ec expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788832898.492535:0:8475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f6c82, blocks: 0x1 00010000:00010000:0.0:1788832898.492551:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:0.0:1788832898.492555:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832898.492563:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a50b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554ec expref: 6 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.492593:0:8475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a50b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554ec expref: 6 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.492606:0:8475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bbe00, rc 0) 00000100:00100000:0.0:1788832898.492685:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2357:x1875726975410560:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 211us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832898.492692:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 27 00000100:00100000:3.0:1788832898.506500:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832898.508265:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975410816 00000100:00100000:0.0:1788832898.508277:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975410816 00000100:00100000:0.0:1788832898.508358:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 79 00000100:00100000:0.0:1788832898.508368:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:10491:x1875726975410816:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788832898.508475:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:10491:x1875726975410816:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 109us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832898.508482:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 79 00000100:00100000:2.0:1788832898.514211:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832898.514355:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975410944 00000100:00100000:3.0:1788832898.514365:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975410944 00000100:00100000:3.0:1788832898.514437:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 28 00000100:00100000:3.0:1788832898.514461:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:10491:x1875726975410944:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832898.514480:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832898.514501:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a50c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b554f3 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.514531:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a50b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554ec expref: 7 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.514552:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832898.514556:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832898.514561:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a50c0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554f3 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.514594:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a50b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554ec expref: 7 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.514608:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a50b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554ec expref: 7 pid: 8475 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832898.514632:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1875726994307840:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832898.514720:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18d003c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832898.526514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832898.526530:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1875726994307840:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832898.526572:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a50c0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554f3 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.526611:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2400, rc 0) 00000100:00100000:3.0:1788832898.526679:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:10491:x1875726975410944:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 12220us (12476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832898.526688:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 28 00000100:00100000:1.0:1788832898.526706:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975411072 00000100:00100000:1.0:1788832898.526714:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975411072 00010000:00010000:1.0:1788832898.526768:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a50b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554ec expref: 7 pid: 8475 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832898.526803:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 42 00000100:00100000:1.0:1788832898.526811:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06e58050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975411072:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832898.526824:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832898.526846:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a50b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554ec expref: 7 pid: 8475 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.526858:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a50b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554ec expref: 7 pid: 8475 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.526879:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a50b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554ec expref: 7 pid: 8475 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.526905:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832898.526909:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832898.526917:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a50c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554f3 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.526928:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a50c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554f3 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.526960:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a50c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554f3 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832898.526973:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5840:1875726994307968:192.168.206.41@tcp:105: 00000100:00100000:1.0:1788832898.527027:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d0bcc6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832898.533049:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5840:1875726994307968:192.168.206.41@tcp:105: 00010000:00010000:0.0:1788832898.533076:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832898.533141:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06e58050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975411072:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 6329us (6635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832898.533152:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 42 00000100:00100000:2.0:1788832898.538476:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832898.538558:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975411200 00000100:00100000:1.0:1788832898.538568:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975411200 00002000:00100000:1.0:1788832898.538627:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff984d3a9fbb80 x1875726975411200/t0(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:84/0 lens 504/0 e 0 to 0 dl 1788832909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832898.538639:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3a9fbb80 with x1875726975411200 ext(0->8) 00002000:00010000:1.0:1788832898.538645:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984d3a9fbb80 00000100:00100000:1.0:1788832898.538678:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00100000:1.0:1788832898.538688:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2357:x1875726975411200:12345-192.168.206.41@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788832898.539314:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2357:x1875726975411200:12345-192.168.206.41@tcp:4:lhsmtool_posix.0 Request processed in 626us (845us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788832898.539339:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 0 00002000:00100000:1.0:1788832898.539347:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff984d3a9fbb80 x1875726975411200/t4294967302(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:84/0 lens 504/448 e 0 to 0 dl 1788832909 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832898.539356:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3a9fbb80 with x1875726975411200 ext(0->8) 00002000:00010000:1.0:1788832898.539361:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984d3a9fbb80 00000100:00100000:2.0:1788832898.548524:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832898.548668:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975411328 00000100:00100000:3.0:1788832898.548678:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975411328 00000100:00100000:3.0:1788832898.548736:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 80 00000100:00100000:3.0:1788832898.548782:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:10491:x1875726975411328:12345-192.168.206.41@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788832898.598790:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:10491:x1875726975411328:12345-192.168.206.41@tcp:44:lhsmtool_posix.0 Request processed in 50037us (50265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832898.598803:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 80 00000001:00080000:3.0:1788832898.598844:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1788832898.598851:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:3.0:1788832898.598941:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:3.0:1788832898.598958:0:5875:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788832898.599052:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788832898.599067:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788832898.599080:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994308096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788832898.599128:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832898.599303:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994308096 00000100:00100000:3.0:1788832898.599309:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994308096 00000100:00100000:3.0:1788832898.599344:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788832898.599353:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994308096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788832898.599546:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788832898.599550:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788832898 00002000:00010000:3.0:1788832898.599562:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788832898.599564:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788832898 -> 1788832898 00002000:00010000:3.0:1788832898.599567:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788832898.599600:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1875726994308096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 247us (471us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788832898.599607:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1788832898.599655:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984d3a9e5f80/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788832898.599661:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994308096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788832898.602405:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832898.602473:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975411456 00000100:00100000:0.0:1788832898.602483:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975411456 00000100:00100000:0.0:1788832898.602865:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 30 00000100:00100000:0.0:1788832898.602877:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2359:x1875726975411456:12345-192.168.206.41@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788832898.643777:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1788832898.643797:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1788832898.644460:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975411456:12345-192.168.206.41@tcp:16:lhsmtool_posix.0 Request processed in 41580us (42057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832898.644471:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 30 00000100:00100000:2.0:1788832898.650222:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832898.650318:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975411712 00000100:00100000:1.0:1788832898.650327:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975411712 00000100:00100000:1.0:1788832898.650385:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 81 00000100:00100000:1.0:1788832898.650395:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:10491:x1875726975411712:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788832898.650444:0:7174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832898.650466:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554e5 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.650484:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832898.650489:0:7174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832898.650526:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.650538:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.650689:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832898.650957:0:7174:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006e0031f reply state 00000000110980ac transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832898.650977:0:7174:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832898.651062:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:10491:x1875726975411712:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 668us (848us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788832898.651069:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 81 00010000:00010000:0.0:1788832898.651873:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832898.656645:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.656662:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.656669:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.656688:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832898.656693:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.656700:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.656716:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff984d113e9400) 00010000:00010000:0.0:1788832898.656719:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832898.656723:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832898.656726:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00010000:00010000:0.0:1788832898.656729:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832898.656949:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975411840 00000100:00100000:3.0:1788832898.656958:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975411840 00000100:00100000:3.0:1788832898.657003:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 31 00000100:00100000:3.0:1788832898.657010:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975411840:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788832898.657201:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788832898.657204:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788832898 -> 1788832897 00002000:00010000:3.0:1788832898.657206:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788832895 00002000:00010000:3.0:1788832898.657208:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788832898 -> 1788832897 00002000:00010000:3.0:1788832898.657210:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788832898.657317:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975411840:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 Request processed in 306us (593us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788832898.657324:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 31 00000100:00100000:0.0:1788832898.660040:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832898.660104:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975412096 00000100:00100000:1.0:1788832898.660114:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975412096 00000100:00100000:1.0:1788832898.660168:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 82 00000100:00100000:1.0:1788832898.660179:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:10491:x1875726975412096:12345-192.168.206.41@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788832898.660238:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.660255:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a508f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554d7 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.660264:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.660295:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a508f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554d7 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.660308:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a508f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554d7 expref: 13 pid: 5853 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832898.660322:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994308224:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832898.660416:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d112ef9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832898.664708:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832898.664890:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975412224 00000100:00100000:0.0:1788832898.664899:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975412224 00010000:00010000:0.0:1788832898.664934:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a508f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554d7 expref: 14 pid: 5853 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832898.664974:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 43 00000100:00100000:0.0:1788832898.664983:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:2357:x1875726975412224:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832898.664997:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832898.665004:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a508f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554d7 expref: 14 pid: 5853 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.665016:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a508f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554d7 expref: 14 pid: 5853 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.665044:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff984d113e9400) 00010000:00010000:0.0:1788832898.665049:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.665058:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.665066:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.665083:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832898.665129:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:2357:x1875726975412224:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 147us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832898.665137:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 43 00010000:00010000:1.0:1788832898.665630:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a508f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554d7 expref: 13 pid: 5853 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832898.665658:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994308224:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832898.665679:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.665687:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.665693:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.665719:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.665726:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.665732:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.665738:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832898.665993:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.666004:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.666016:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff984d113e9400) 00010000:00010000:1.0:1788832898.666019:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788832898.666024:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.666037:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a50ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832898.666094:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:10491:x1875726975412096:12345-192.168.206.41@tcp:55:lhsmtool_posix.0 Request processed in 5917us (6062us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788832898.666103:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 82 00000100:00100000:2.0:1788832898.668990:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832898.669160:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975412352 00000100:00100000:3.0:1788832898.669169:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975412352 00000100:00100000:3.0:1788832898.669239:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 32 00000100:00100000:3.0:1788832898.669249:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975412352:12345-192.168.206.41@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788832898.669300:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.669319:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a50c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554f3 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.669326:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832898.669330:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832898.669334:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.669368:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a50c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554f3 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.669382:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a50c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554f3 expref: 7 pid: 6698 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832898.669396:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1875726994308352:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832898.669478:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d18d00300 going to sleep for 11 seconds 00000100:00100000:3.0:1788832898.671723:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1875726994308352:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832898.671778:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832898.674056:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832898.674444:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975412480 00000100:00100000:3.0:1788832898.674464:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975412480 00010000:00010000:3.0:1788832898.674560:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a50c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554f3 expref: 8 pid: 6698 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832898.674645:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 44 00000100:00100000:3.0:1788832898.674657:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2358:x1875726975412480:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832898.674672:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832898.674695:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a50c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554f3 expref: 8 pid: 6698 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.674709:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a50c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554f3 expref: 8 pid: 6698 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.674731:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a50c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554f3 expref: 8 pid: 6698 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.674780:0:7639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832898.674785:0:7639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832898.674790:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.674800:0:7639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.674828:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832898.674994:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.675006:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.675031:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.675040:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.675048:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832898.675054:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975412480:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 395us (998us total) trans 0 rc 0/0 00010000:00010000:1.0:1788832898.675062:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788832898.675068:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.675084:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832898.675085:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 44 00010000:00010000:1.0:1788832898.675108:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.675116:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a50d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832898.675169:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975412352:12345-192.168.206.41@tcp:1:lhsmtool_posix.0 Request processed in 5921us (6185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832898.675178:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 32 00000100:00100000:2.0:1788832898.677329:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832898.677473:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975412736 00000100:00100000:1.0:1788832898.677482:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975412736 00000100:00100000:1.0:1788832898.677539:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 83 00000100:00100000:1.0:1788832898.677549:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:10491:x1875726975412736:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788832898.677628:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.677644:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.677655:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.677887:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.677899:0:7174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a509d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554de expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.677922:0:7174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.677954:0:7174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a509d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554de expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.677968:0:7174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a509d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554de expref: 13 pid: 5855 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832898.677982:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994308480:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832898.678051:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d112ef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832898.681478:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994308480:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832898.681516:0:7174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832898.684072:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832898.684154:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975412864 00000100:00100000:0.0:1788832898.684163:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975412864 00010000:00010000:0.0:1788832898.684199:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a509d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554de expref: 14 pid: 5855 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832898.684232:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 45 00000100:00100000:0.0:1788832898.684241:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:2358:x1875726975412864:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832898.684254:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832898.684260:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a509d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554de expref: 14 pid: 5855 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.684271:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a509d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554de expref: 14 pid: 5855 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.684308:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a509d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554de expref: 14 pid: 5855 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.684323:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff984d113e9400) 00010000:00010000:0.0:1788832898.684328:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.684336:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.684343:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.684501:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832898.684563:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:2358:x1875726975412864:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 323us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832898.684572:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 45 00010000:00010000:1.0:1788832898.685786:0:7174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.685860:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788832898.686020:0:7174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788832898.686119:0:7174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788832898.686146:0:7174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788832898.686238:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7174:1875726994308608:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788832898.686285:0:7174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832898.686509:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d11418780 going to sleep for 11 seconds 00000100:00100000:3.0:1788832898.686641:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994308608 00000100:00100000:3.0:1788832898.686648:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994308608 00000100:00100000:3.0:1788832898.686723:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788832898.686733:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7174:x1875726994308608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788832898.686848:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7174:x1875726994308608:12345-0@lo:1000:mdt00_003.0 Request processed in 117us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832898.686856:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788832898.686927:0:7174:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788832898.686933:0:7174:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984d3a9e5f80, transno 4294967303 00000100:00100000:2.0:1788832898.686955:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7174:1875726994308608:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788832898.687341:0:7174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788832898.687402:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7174:1875726994308736:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788832898.687444:0:7174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832898.687471:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788832898.687645:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994308736 00000100:00100000:0.0:1788832898.687650:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994308736 00000100:00100000:0.0:1788832898.687683:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832898.687691:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7174:x1875726994308736:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788832898.687859:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7174:x1875726994308736:12345-0@lo:1000:mdt00_003.0 Request processed in 169us (414us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788832898.687866:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832898.688037:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7174:1875726994308736:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788832898.688065:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688075:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688082:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688088:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832898.688092:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688100:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688113:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff984d113e9400) 00010000:00010000:2.0:1788832898.688116:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788832898.688121:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688127:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a50e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688159:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5011 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688165:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5011 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688176:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5011 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688181:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832898.688185:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5011 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688191:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5011 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688199:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d02d42500) 00010000:00010000:2.0:1788832898.688201:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788832898.688204:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5011 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688209:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5011 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688228:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688240:0:7174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a502d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554c2 expref: 16 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688249:0:7174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688266:0:7174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a502d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554c2 expref: 16 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832898.688283:0:7174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a502d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554c2 expref: 16 pid: 7174 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832898.688291:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994308864:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832898.688356:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832898.690865:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994308864:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832898.690950:0:7174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832898.691323:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832898.691986:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975412992 00000100:00100000:0.0:1788832898.691994:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975412992 00010000:00010000:0.0:1788832898.692026:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a502d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554c2 expref: 17 pid: 7174 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832898.692077:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 46 00000100:00100000:0.0:1788832898.692086:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:2357:x1875726975412992:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832898.692099:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832898.692105:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a502d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554c2 expref: 17 pid: 7174 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.692116:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a502d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554c2 expref: 17 pid: 7174 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.692142:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a502d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554c2 expref: 17 pid: 7174 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.692157:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d02d42500) 00010000:00010000:0.0:1788832898.692161:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.692170:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.692176:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832898.692203:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832898.692254:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:2357:x1875726975412992:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 169us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832898.692262:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 46 00010000:00010000:1.0:1788832898.692276:0:7174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692284:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692295:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692302:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692309:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692319:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832898.692324:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692330:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692339:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832898.692342:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832898.692345:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692352:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a50ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692369:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692375:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692380:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692385:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832898.692387:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692392:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692400:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832898.692403:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788832898.692406:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.692411:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a50dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832898.692927:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:10491:x1875726975412736:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 15378us (15604us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788832898.692937:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 83 00000020:00080000:1.0:1788832898.692942:0:7174:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788832898.693069:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832898.693080:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832898.693108:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788832898.693114:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788832898.695232:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832898.695431:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975413248 00000100:00100000:1.0:1788832898.695440:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975413248 00000100:00100000:1.0:1788832898.695643:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 20 00000100:00100000:1.0:1788832898.695654:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:10491:x1875726975413248:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788832898.696305:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788832898.696405:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788832898.696452:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a50f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.696468:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a50f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.696479:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a50f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.696487:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a50f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.696900:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a50f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.696909:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a50f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832898.696936:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788832898.697023:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:10491:x1875726975413248:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 1369us (1795us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788832898.697032:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 20 00000020:00080000:1.0:1788832898.697038:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788832898.697246:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832898.697254:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a50f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.697263:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788832898.697267:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a50f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.697276:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a50f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.697290:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff984d02d42a00) 00010000:00010000:3.0:1788832898.697294:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788832898.697298:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a50f1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.697386:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a50f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832898.697405:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832898.697416:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832898.697418:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832898.710858:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994308992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832898.710928:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832898.711092:0:11720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994308992 00000100:00100000:1.0:1788832898.711101:0:11720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994308992 00000100:00100000:1.0:1788832898.711189:0:11720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788832898.711198:0:11720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875726994308992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832898.711243:0:11720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832898.711296:0:11720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875726994308992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832898.711303:0:11720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788832898.711372:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994308992:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788832899.669990:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788832900.291965:0:12068:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832900.291974:0:12068:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832900.292008:0:12068:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788832900.292025:0:12068:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788832900.453217:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832900.453422:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975413504 00000100:00100000:0.0:1788832900.453431:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975413504 00000100:00100000:0.0:1788832900.453536:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 84 00000100:00100000:0.0:1788832900.453545:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:10510:x1875726975413504:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788832900.453566:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832900.453584:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a50f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b554fa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788832900.453633:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788832900.453682:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a50ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.453696:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a50ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.453709:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a50ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832900.453719:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788832900.453851:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a50f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554fa expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.453878:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a50ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554fa expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.453901:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:0.0:1788832900.453904:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788832900.453907:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036ba600, rc 0) 00000100:00100000:0.0:1788832900.453959:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:10510:x1875726975413504:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 415us (751us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788832900.453966:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 84 00000100:00100000:2.0:1788832900.457970:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832900.458263:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975413632 00000100:00100000:1.0:1788832900.458273:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975413632 00000100:00100000:1.0:1788832900.458329:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 85 00000100:00100000:1.0:1788832900.458338:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:10510:x1875726975413632:12345-192.168.206.41@tcp:34:lfs.0 00010000:00010000:1.0:1788832900.458402:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a510d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458419:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a510d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458430:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a510d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458444:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5114 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458451:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458458:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458722:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a511b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458731:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a511b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458772:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a511b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832900.458807:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a511b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458820:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a510d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458825:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a510d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458831:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a510d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458836:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832900.458840:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a510d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458847:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a510d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458857:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:1.0:1788832900.458859:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832900.458863:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a510d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458868:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a510d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458880:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458892:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5114 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458898:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458903:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832900.458906:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458913:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5114 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458921:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d02d42500) 00010000:00010000:1.0:1788832900.458923:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832900.458926:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5114 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458931:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5114 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458944:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a511b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458950:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a511b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458955:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a511b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458960:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832900.458969:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a511b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458974:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a511b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458981:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:1.0:1788832900.458984:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832900.458986:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a511b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.458992:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a511b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832900.459063:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:10510:x1875726975413632:12345-192.168.206.41@tcp:34:lfs.0 Request processed in 725us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832900.459070:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 85 00000100:00100000:1.0:1788832900.536306:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832900.536388:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975413888 00000100:00100000:0.0:1788832900.536397:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975413888 00000100:00100000:0.0:1788832900.536462:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 86 00000100:00100000:0.0:1788832900.536471:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:10513:x1875726975413888:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788832900.536491:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832900.536509:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a5122 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55501 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.536575:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5129 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.536589:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5129 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.536599:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5129 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.536623:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5130 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.536631:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.536654:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.536917:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a5137 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.536926:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a5137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.536934:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a5137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832900.536943:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788832900.537257:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5129 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537265:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5129 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537271:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5129 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537277:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832900.537280:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5129 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537287:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5129 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537298:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:0.0:1788832900.537301:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832900.537311:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5129 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537317:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5129 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537327:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537333:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5130 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537338:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537343:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832900.537346:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537351:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5130 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537359:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d03c60e00) 00010000:00010000:0.0:1788832900.537361:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832900.537364:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5130 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537369:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5130 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537529:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a5122 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55501 expref: 22 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537557:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a5137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55501 expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.537565:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60400) 00010000:00010000:0.0:1788832900.537567:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832900.537570:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bb400, rc 0) 00000100:00100000:0.0:1788832900.537671:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:10513:x1875726975413888:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 1200us (1372us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788832900.537679:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 86 00000100:00100000:3.0:1788832900.554289:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832900.556702:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975414016 00000100:00100000:1.0:1788832900.556715:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975414016 00000100:00100000:1.0:1788832900.556804:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 87 00000100:00100000:1.0:1788832900.556814:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:10513:x1875726975414016:12345-192.168.206.41@tcp:54:lfs.0 00010000:00010000:1.0:1788832900.557052:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.557069:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.557081:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.557118:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.557125:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5145 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.557132:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.557138:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832900.557142:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.557149:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5145 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.557160:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60400) 00010000:00010000:1.0:1788832900.557163:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832900.557167:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5145 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.557173:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832900.557269:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:10513:x1875726975414016:12345-192.168.206.41@tcp:54:lfs.0 Request processed in 456us (2987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832900.557277:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 87 00000100:00100000:2.0:1788832900.569054:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832900.569390:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975414272 00000100:00100000:0.0:1788832900.569399:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975414272 00000100:00100000:0.0:1788832900.569681:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 21 00000100:00100000:0.0:1788832900.569690:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d18422850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:10513:x1875726975414272:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:0.0:1788832900.570036:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d18422850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+22:10513:x1875726975414272:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 346us (988us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788832900.570044:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 21 00000100:00100000:3.0:1788832900.668064:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832900.669432:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975414528 00000100:00100000:1.0:1788832900.669444:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975414528 00000100:00100000:1.0:1788832900.669515:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 88 00000100:00100000:1.0:1788832900.669537:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+22:10034:x1875726975414528:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:1.0:1788832900.669559:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832900.669576:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a514c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55508 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.669670:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.669684:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a5137 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55501 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.669692:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.669723:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a5137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55501 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.669736:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a5137 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55501 expref: 23 pid: 5853 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832900.669798:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994309120:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832900.670286:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d11418300 going to sleep for 11 seconds 00000100:00100000:1.0:1788832900.681445:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994309120:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832900.681535:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832900.681920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832900.681971:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975414656 00000100:00100000:1.0:1788832900.681977:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975414656 00010000:00010000:1.0:1788832900.682019:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a5137 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55501 expref: 24 pid: 5853 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832900.684021:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 47 00000100:00100000:1.0:1788832900.684041:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+24:2358:x1875726975414656:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832900.684058:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832900.684068:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a5137 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55501 expref: 24 pid: 5853 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.684084:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a5137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55501 expref: 24 pid: 5853 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.684105:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb400/0xd270a10c1c6a5137 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55501 expref: 24 pid: 5853 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.684120:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60400) 00010000:00010000:1.0:1788832900.684125:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.684133:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.684140:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.684176:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832900.684236:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+23:2358:x1875726975414656:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 203us (2317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832900.684243:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 47 00010000:00010000:3.0:1788832900.685332:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.685346:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832900.685373:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788832900.685520:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a514c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55508 expref: 24 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.685539:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55508 expref: 23 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.685547:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60400) 00010000:00010000:3.0:1788832900.685550:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832900.685553:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05e00, rc 0) 00000100:00100000:3.0:1788832900.685617:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+23:10034:x1875726975414528:12345-192.168.206.41@tcp:101:bash.0 Request processed in 16081us (17561us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788832900.685625:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 88 00000100:00100000:3.0:1788832900.689995:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832900.690215:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975414912 00000100:00100000:2.0:1788832900.690225:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975414912 00000100:00100000:2.0:1788832900.690279:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 89 00000100:00100000:2.0:1788832900.690289:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+23:10034:x1875726975414912:12345-192.168.206.41@tcp:36:bash.0 00010000:00010000:2.0:1788832900.690538:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5161 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832900.690554:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832900.690565:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832900.690641:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788832900.690665:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e0e6cdb reply state 000000000b2bbbb6 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832900.690674:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788832900.690794:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788832900.691006:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+27:10034:x1875726975414912:12345-192.168.206.41@tcp:36:bash.0 Request processed in 717us (1019us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788832900.691014:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 89 00000020:00080000:2.0:1788832900.691018:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788832900.693050:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.693065:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5161 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.693072:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.693079:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832900.693084:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.693099:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5161 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.693116:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60400) 00010000:00010000:1.0:1788832900.693118:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832900.693123:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5161 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.693130:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5161 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832900.693444:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832900.693540:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975415040 00000100:00100000:0.0:1788832900.693548:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975415040 00000100:00100000:0.0:1788832900.693600:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 90 00000100:00100000:0.0:1788832900.693619:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:10034:x1875726975415040:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:0.0:1788832900.693642:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832900.693659:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5168 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5550f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.693715:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5550f expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.693777:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5550f expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832900.693802:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60400) 00010000:00010000:0.0:1788832900.693805:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788832900.693808:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bb000, rc 0) 00000100:00100000:0.0:1788832900.693856:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+27:10034:x1875726975415040:12345-192.168.206.41@tcp:101:bash.0 Request processed in 239us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832900.693875:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 90 00010000:00010000:0.0:1788832900.695135:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832900.701531:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832900.701685:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975415168 00000100:00100000:3.0:1788832900.701696:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975415168 00000100:00100000:3.0:1788832900.701862:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 33 00000100:00100000:3.0:1788832900.701882:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:10034:x1875726975415168:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:3.0:1788832900.701899:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832900.701962:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a516f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55516 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832900.702002:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f6c81, atime: 0x6a9f6c7f, ctime: 0x6a9f6c81, blocks: 0xb 00010000:00010000:3.0:1788832900.702022:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1788832900.702026:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832900.702034:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a516f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55516 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.702052:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a516f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55516 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.702064:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2400, rc 0) 00000100:00100000:3.0:1788832900.702127:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:10034:x1875726975415168:12345-192.168.206.41@tcp:101:bash.0 Request processed in 247us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832900.702134:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 33 00000100:00080000:1.0:1788832900.707725:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788832900.708918:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832900.709092:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975415296 00000100:00100000:1.0:1788832900.709101:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975415296 00002000:00010000:1.0:1788832900.709136:0:6704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788832900.709140:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3a9f8a80 with x1875726975415296 ext(0->18446744073709551615) 00002000:00010000:1.0:1788832900.709151:0:6704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984d3a9f8a80. 00000100:00100000:1.0:1788832900.709187:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 1 00000100:00100000:1.0:1788832900.709197:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975415296:12345-192.168.206.41@tcp:10:bash.0 00002000:00010000:1.0:1788832900.709623:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788832900.709627:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788832897 -> 1788832901 00002000:00010000:1.0:1788832900.709630:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788832895 -> 1788832895 00002000:00010000:1.0:1788832900.709632:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788832897 -> 1788832901 00002000:00010000:1.0:1788832900.709633:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788832900.709729:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2357:x1875726975415296:12345-192.168.206.41@tcp:10:bash.0 Request processed in 532us (817us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788832900.709736:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 1 00002000:00010000:1.0:1788832900.709772:0:6704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788832900.709776:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3a9f8a80 with x1875726975415296 ext(0->18446744073709551615) 00002000:00010000:1.0:1788832900.709781:0:6704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984d3a9f8a80. 00000040:00080000:0.0:1788832900.759011:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832900.759020:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832900.759050:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788832900.759057:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788832900.814480:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832900.814577:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975415424 00000100:00100000:1.0:1788832900.814586:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975415424 00000100:00100000:1.0:1788832900.814657:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 91 00000100:00100000:1.0:1788832900.814667:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+27:10527:x1875726975415424:12345-192.168.206.41@tcp:34:lfs.0 00010000:00010000:1.0:1788832900.814729:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5176 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.814774:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.814787:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.814802:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a517d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.814809:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a517d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.814837:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a517d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815050:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815059:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815066:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832900.815103:0:7174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815115:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815121:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5176 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815127:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5176 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815133:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832900.815137:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5176 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815143:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5176 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815154:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:1.0:1788832900.815162:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832900.815168:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815174:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815186:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a517d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815192:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a517d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815197:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a517d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815202:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832900.815204:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a517d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815210:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a517d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815217:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d02d42500) 00010000:00010000:1.0:1788832900.815220:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832900.815223:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a517d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815229:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a517d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815242:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815253:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5184 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815258:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815263:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832900.815266:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815272:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815280:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60400) 00010000:00010000:1.0:1788832900.815282:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832900.815285:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5184 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832900.815489:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832900.815664:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+27:10527:x1875726975415424:12345-192.168.206.41@tcp:34:lfs.0 Request processed in 996us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832900.815673:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 91 00000001:00080000:0.0:1788832900.821102:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1788832900.884451:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832900.884858:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975415680 00000100:00100000:3.0:1788832900.884875:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975415680 00000100:00100000:3.0:1788832900.884928:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 92 00000100:00100000:3.0:1788832900.884938:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+27:10530:x1875726975415680:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:3.0:1788832900.884956:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832900.884974:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a518b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5551d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886000:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a5192 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886026:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a5192 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886036:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a5192 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886164:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5199 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886173:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886180:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886497:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a51a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886507:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a51a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886515:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a51a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832900.886524:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788832900.886618:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a5192 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886625:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a5192 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886637:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a5192 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886643:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832900.886647:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a5192 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886653:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a5192 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886665:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:3.0:1788832900.886668:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832900.886672:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a5192 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886678:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a5192 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886690:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886696:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5199 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886701:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5199 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886706:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832900.886709:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5199 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886724:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5199 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886732:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d113e9300) 00010000:00010000:3.0:1788832900.886734:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832900.886737:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5199 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.886786:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5199 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.887391:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a518b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5551d expref: 30 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.887407:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a51a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5551d expref: 29 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.887415:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60400) 00010000:00010000:3.0:1788832900.887417:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788832900.887420:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3400, rc 0) 00000100:00100000:3.0:1788832900.887526:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+29:10530:x1875726975415680:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 2588us (3080us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788832900.887535:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 92 00000100:00100000:0.0:1788832900.895721:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832900.896249:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975415808 00000100:00100000:3.0:1788832900.896260:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975415808 00000100:00100000:3.0:1788832900.896377:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 93 00000100:00100000:3.0:1788832900.896386:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+29:10530:x1875726975415808:12345-192.168.206.41@tcp:54:lfs.0 00010000:00010000:3.0:1788832900.896461:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.896476:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55508 expref: 29 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.896485:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.896517:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55508 expref: 29 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.896656:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55508 expref: 29 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832900.896671:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994309248:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832900.896911:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d036a7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832900.901518:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994309248:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832900.901546:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832900.908675:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832900.913197:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975416064 00000100:00100000:2.0:1788832900.913210:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975416064 00000100:00100000:2.0:1788832900.914121:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 22 00000100:00100000:2.0:1788832900.914138:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+30:5594:x1875726975416064:12345-192.168.206.41@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788832900.914434:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+31:5594:x1875726975416064:12345-192.168.206.41@tcp:35:ldlm_bl.0 Request processed in 302us (5766us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788832900.914442:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 22 00000100:00100000:0.0:1788832900.918322:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832900.918433:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975416192 00000100:00100000:3.0:1788832900.918442:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975416192 00010000:00010000:3.0:1788832900.918497:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55508 expref: 31 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832900.918541:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 48 00000100:00100000:3.0:1788832900.918551:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+31:2357:x1875726975416192:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832900.918578:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832900.918586:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55508 expref: 31 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.918598:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55508 expref: 31 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.918630:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5153 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55508 expref: 31 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.918646:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60400) 00010000:00010000:3.0:1788832900.918651:0:7639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.918661:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.918669:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832900.918702:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832900.918783:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+30:2357:x1875726975416192:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 232us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832900.918791:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 48 00010000:00010000:2.0:1788832900.919785:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832900.919797:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832900.919828:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832900.919835:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832900.919853:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832900.919858:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832900.919862:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832900.920296:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832900.920310:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60400) 00010000:00010000:2.0:1788832900.920313:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832900.920317:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832900.920322:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a51ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832900.920392:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3acce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+29:10530:x1875726975415808:12345-192.168.206.41@tcp:54:lfs.0 Request processed in 24005us (24678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832900.920400:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 93 00000100:00100000:0.0:1788832900.927409:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832900.927615:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975416448 00000100:00100000:1.0:1788832900.927625:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975416448 00000100:00100000:1.0:1788832900.927677:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 23 00000100:00100000:1.0:1788832900.927686:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+29:10530:x1875726975416448:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:1.0:1788832900.927925:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+30:10530:x1875726975416448:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 239us (523us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788832900.927944:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 23 00000100:00100000:0.0:1788832901.090238:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832901.090344:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975416704 00000100:00100000:1.0:1788832901.090354:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975416704 00000100:00100000:1.0:1788832901.090414:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 94 00000100:00100000:1.0:1788832901.090423:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+30:10541:x1875726975416704:12345-192.168.206.41@tcp:101:cat.0 00010000:00010000:1.0:1788832901.090446:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832901.090464:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a51b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55524 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.090649:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.090665:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.090676:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.090690:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.090697:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.090704:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091079:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a51ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091100:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a51ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091107:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a51ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832901.091117:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788832901.091202:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091210:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091216:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091222:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832901.091225:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091232:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091244:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:1.0:1788832901.091247:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832901.091251:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091256:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091268:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091279:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091286:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091291:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832901.091299:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091306:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091314:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d02d42500) 00010000:00010000:1.0:1788832901.091317:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832901.091320:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.091326:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.093772:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a51b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55524 expref: 33 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.093800:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a51ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55524 expref: 32 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.093809:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60400) 00010000:00010000:1.0:1788832901.093811:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832901.093829:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05200, rc 0) 00000100:00100000:1.0:1788832901.093911:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+32:10541:x1875726975416704:12345-192.168.206.41@tcp:101:cat.0 Request processed in 3487us (3680us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788832901.093927:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 94 00000100:00100000:0.0:1788832901.102320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832901.102392:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975416960 00000100:00100000:1.0:1788832901.102402:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975416960 00000100:00100000:1.0:1788832901.102452:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 24 00000100:00100000:1.0:1788832901.102462:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3acce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+32:10541:x1875726975416960:12345-192.168.206.41@tcp:35:cat.0 00000100:00100000:1.0:1788832901.102704:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3acce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+33:10541:x1875726975416960:12345-192.168.206.41@tcp:35:cat.0 Request processed in 242us (391us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788832901.102712:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 24 00000100:00100000:0.0:1788832901.138509:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832901.138613:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975417216 00000100:00100000:1.0:1788832901.138623:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975417216 00000100:00100000:1.0:1788832901.138689:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 95 00000100:00100000:1.0:1788832901.138700:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+33:10542:x1875726975417216:12345-192.168.206.41@tcp:36:rm.0 00010000:00010000:1.0:1788832901.138785:0:7174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788832901.138811:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a51ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55524 expref: 33 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.138831:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a51a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5551d expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.138844:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5168 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5550f expref: 31 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.138855:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d03c60400) 00010000:00010000:1.0:1788832901.138865:0:7174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832901.138899:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a51d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.138912:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a51d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.138936:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a51d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.138951:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.138959:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.138971:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.139180:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.139189:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.139196:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788832901.140262:0:7174:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1788832901.140274:0:7174:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 404830529281ns, next at 405830526493ns, rc = 0 00010000:00010000:1.0:1788832901.140340:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a51ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140352:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a51ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140370:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a51ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140376:0:7174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a51ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140382:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a51ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140388:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a51ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140416:0:7174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788832901.140438:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140444:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140450:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140455:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832901.140459:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140467:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140477:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:1.0:1788832901.140481:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788832901.140491:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140497:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a51e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140513:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a51d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140519:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a51d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140525:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a51d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140530:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832901.140532:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a51d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140538:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a51d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140546:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:1.0:1788832901.140548:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832901.140551:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a51d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.140556:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a51d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832901.140565:0:7174:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000629143a8 reply state 000000005b468334 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832901.140596:0:7174:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832901.140684:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+32:10542:x1875726975417216:12345-192.168.206.41@tcp:36:rm.0 Request processed in 1984us (2181us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788832901.140691:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 95 00010000:00010000:2.0:1788832901.143089:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832901.143101:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a51ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.143112:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05e00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788832901.143117:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a51ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.143125:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a51ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.143154:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832901.143157:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788832901.143162:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a51ed lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.143168:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a51ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.143188:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832901.143190:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832901.143192:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832901.150416:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.150434:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.150442:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.150448:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832901.150453:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.150460:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.150478:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d02d42500) 00010000:00010000:1.0:1788832901.150481:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832901.150485:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.150491:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a51df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832901.236346:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832901.236727:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975417472 00000100:00100000:3.0:1788832901.236736:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975417472 00000100:00100000:3.0:1788832901.236815:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 96 00000100:00100000:3.0:1788832901.236824:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+31:10548:x1875726975417472:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:3.0:1788832901.236859:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832901.236889:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a51f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5552b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237004:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a51fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237018:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a51fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237028:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a51fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237043:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5202 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237049:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5202 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237055:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5202 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788832901.237545:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788832901.237717:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a5209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237726:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a5209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237734:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a5209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237801:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a51fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237808:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a51fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237814:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a51fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237819:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832901.237823:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a51fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237830:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a51fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237841:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:3.0:1788832901.237844:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832901.237849:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a51fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237855:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a51fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788832901.237866:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000964a775a reply state 0000000057652c58 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5202 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832901.237874:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788832901.237898:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a51f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5552b expref: 34 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237921:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a5209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5552b expref: 33 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.237928:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d113e9000) 00010000:00010000:3.0:1788832901.237931:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832901.237933:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2600, rc 0) 00000100:00100000:3.0:1788832901.237993:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+34:10548:x1875726975417472:12345-192.168.206.41@tcp:101:bash.0 Request processed in 1169us (1654us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788832901.238000:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 96 00010000:00010000:1.0:1788832901.243221:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5202 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.243254:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5202 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.243262:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5202 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.243268:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832901.243273:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5202 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.243281:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5202 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.243297:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d113e9300) 00010000:00010000:1.0:1788832901.243300:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832901.243304:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5202 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.243311:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5202 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832901.245420:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832901.245671:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975417600 00000100:00100000:3.0:1788832901.245680:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975417600 00000100:00100000:3.0:1788832901.245792:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 34 00000100:00100000:3.0:1788832901.245804:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975417600:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:3.0:1788832901.245820:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832901.245840:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a5217 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55532 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832901.245878:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788832901.245909:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1788832901.245913:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832901.245922:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a5217 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55532 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.245940:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a5217 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55532 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788832901.246175:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788832901.246208:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3600, rc 0) 00000100:00100000:3.0:1788832901.246265:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975417600:12345-192.168.206.41@tcp:101:bash.0 Request processed in 464us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832901.246273:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 34 00000100:00100000:0.0:1788832901.254943:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832901.255033:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975417728 00000100:00100000:3.0:1788832901.255042:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975417728 00000100:00100000:3.0:1788832901.255244:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 35 00000100:00100000:3.0:1788832901.255255:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:10548:x1875726975417728:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:3.0:1788832901.255273:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832901.255291:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55539 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.255331:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a5217 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55532 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.255342:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832901.255346:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832901.255351:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.255392:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a5217 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55532 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.255405:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a5217 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55532 expref: 7 pid: 6700 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832901.255432:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1875726994309376:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832901.255541:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d036a7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832901.260162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832901.260214:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1875726994309376:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832901.260248:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.260269:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2200, rc 0) 00000100:00100000:3.0:1788832901.260350:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:10548:x1875726975417728:12345-192.168.206.41@tcp:101:bash.0 Request processed in 5096us (5413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832901.260804:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 35 00000100:00100000:2.0:1788832901.261002:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975417856 00000100:00100000:2.0:1788832901.261010:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975417856 00010000:00010000:2.0:1788832901.261041:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a5217 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55532 expref: 7 pid: 6700 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832901.261124:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 49 00000100:00100000:2.0:1788832901.261142:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06e58850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975417856:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832901.261157:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832901.261178:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a5217 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55532 expref: 7 pid: 6700 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.261191:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a5217 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55532 expref: 7 pid: 6700 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.261214:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a5217 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55532 expref: 7 pid: 6700 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.261245:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832901.261249:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832901.261257:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.261267:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.261301:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832901.261315:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5839:1875726994309504:192.168.206.41@tcp:105: 00000100:00100000:2.0:1788832901.261388:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832901.263482:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5839:1875726994309504:192.168.206.41@tcp:105: 00010000:00010000:2.0:1788832901.263507:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832901.263624:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06e58850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2357:x1875726975417856:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 2489us (3467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832901.263633:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 49 00000100:00100000:0.0:1788832901.265499:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832901.265875:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975418112 00000100:00100000:1.0:1788832901.265884:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975418112 00000100:00100000:1.0:1788832901.266175:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 25 00000100:00100000:1.0:1788832901.266186:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+33:10548:x1875726975418112:12345-192.168.206.41@tcp:35:bash.0 00000100:00100000:1.0:1788832901.266527:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+34:10548:x1875726975418112:12345-192.168.206.41@tcp:35:bash.0 Request processed in 334us (1026us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788832901.266535:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 25 00000100:00100000:1.0:1788832901.531706:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832901.531860:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975418240 00000100:00100000:2.0:1788832901.531878:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975418240 00000100:00100000:2.0:1788832901.532036:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 97 00000100:00100000:2.0:1788832901.532047:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+34:10564:x1875726975418240:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832901.532071:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832901.532091:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5225 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55540 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.532175:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a522c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.532190:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a522c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.532201:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a522c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832901.532232:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788832901.532236:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788832901.532254:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a522c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.532276:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5225 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55540 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.532293:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a522c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55540 expref: 35 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.532301:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:2.0:1788832901.532304:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832901.532514:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702000, rc 0) 00000100:00100000:2.0:1788832901.532580:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+35:10564:x1875726975418240:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 535us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832901.532587:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 97 00000100:00100000:0.0:1788832901.541147:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832901.541228:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975418496 00000100:00100000:3.0:1788832901.541238:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975418496 00000100:00100000:3.0:1788832901.541297:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 98 00000100:00100000:3.0:1788832901.541307:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+35:10564:x1875726975418496:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:3.0:1788832901.541326:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832901.541345:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5233 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55547 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.541436:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a523a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.541450:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a523a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.541474:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a523a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832901.541497:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788832901.541627:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5233 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55547 expref: 38 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.541647:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a523a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55547 expref: 37 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.541655:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d113e9000) 00010000:00010000:3.0:1788832901.541658:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832901.541661:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3e00, rc 0) 00000100:00100000:3.0:1788832901.541737:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+37:10564:x1875726975418496:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 430us (598us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788832901.541790:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 98 00000100:00100000:0.0:1788832901.549997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832901.550103:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832901.550182:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975418880 00000100:00100000:1.0:1788832901.550191:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975418880 00000100:00100000:1.0:1788832901.550241:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 99 00000100:00100000:1.0:1788832901.550250:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+37:10564:x1875726975418880:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832901.550271:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832901.550289:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5248 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5554e expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.550397:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a524f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832901.550398:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975418624 00000100:00100000:3.0:1788832901.550404:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975418624 00000100:00100000:3.0:1788832901.550450:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:3.0:1788832901.550459:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+39:2357:x1875726975418624:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832901.550470:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832901.550520:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a524f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.550533:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a524f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832901.550546:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788832901.554263:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a523a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55547 expref: 41 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.554272:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5248 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5554e expref: 41 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.554294:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d113e9000) 00010000:00010000:3.0:1788832901.554300:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832901.554519:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+40:2357:x1875726975418624:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 4058us (4528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832901.554530:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 6 00010000:00010000:1.0:1788832901.554563:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a524f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5554e expref: 38 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.554573:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d113e9000) 00010000:00010000:1.0:1788832901.554576:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788832901.554579:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04c00, rc 0) 00000100:00100000:0.0:1788832901.555148:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+38:10564:x1875726975418880:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 4896us (5042us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788832901.555156:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 99 00000100:00100000:2.0:1788832901.573087:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832901.573181:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975419008 00000100:00100000:1.0:1788832901.573192:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975419008 00000100:00100000:1.0:1788832901.573371:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 36 00000100:00100000:1.0:1788832901.573383:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975419008:12345-192.168.206.41@tcp:1:lfs.0 00010000:00010000:1.0:1788832901.573659:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.573680:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.573689:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788832901.573693:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788832901.573697:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.573880:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.573895:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 6 pid: 6699 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832901.573911:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a573b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875726994309632:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832901.574007:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d114183c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832901.579455:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a573b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875726994309632:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832901.579553:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832901.580042:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832901.580133:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975419136 00000100:00100000:0.0:1788832901.580140:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975419136 00002000:00100000:0.0:1788832901.580182:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff984d3a9fb480 x1875726975419136/t0(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:87/0 lens 504/0 e 0 to 0 dl 1788832912 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788832901.580192:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3a9fb480 with x1875726975419136 ext(0->8) 00010000:00010000:0.0:1788832901.580429:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 7 pid: 6699 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.580444:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 7 pid: 6699 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788832901.580452:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff984d3a9fb480 00000100:00100000:0.0:1788832901.580606:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 1 00000100:00100000:0.0:1788832901.580618:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975419136:12345-192.168.206.41@tcp:4:lfs.0 00000100:00100000:0.0:1788832901.581109:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2358:x1875726975419136:12345-192.168.206.41@tcp:4:lfs.0 Request processed in 491us (1066us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788832901.581117:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 1 00002000:00100000:0.0:1788832901.581124:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff984d3a9fb480 x1875726975419136/t4294967302(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:87/0 lens 504/448 e 0 to 0 dl 1788832912 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788832901.581132:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3a9fb480 with x1875726975419136 ext(0->8) 00010000:00010000:0.0:1788832901.581138:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 9 pid: 6699 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.581149:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 9 pid: 6699 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788832901.581157:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff984d3a9fb480 00000100:00100000:3.0:1788832901.587048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832901.587215:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975419264 00000100:00100000:1.0:1788832901.587236:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975419264 00010000:00010000:1.0:1788832901.587273:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 9 pid: 6699 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832901.587322:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 50 00000100:00100000:1.0:1788832901.587332:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2360:x1875726975419264:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832901.587346:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788832901.587364:0:5838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788832901.587367:0:5838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788832901 00002000:00010000:1.0:1788832901.587370:0:5838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788832901 00002000:00010000:1.0:1788832901.587372:0:5838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788832901 00010000:00010000:1.0:1788832901.587378:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 9 pid: 6699 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.587392:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 9 pid: 6699 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.587635:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c750c4ee/0xd270a10c1c6a521e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55539 expref: 9 pid: 6699 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.587655:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788832901.587659:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788832901.587665:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.587674:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.587922:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832901.587972:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2360:x1875726975419264:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 642us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832901.587981:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 50 00010000:00010000:3.0:1788832901.594325:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.594364:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.594668:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.594679:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.594689:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.594696:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05200 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788832901.594700:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.594709:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.594729:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.594736:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0d8e751/0xd270a10c1c6a525d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832901.594850:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975419008:12345-192.168.206.41@tcp:1:lfs.0 Request processed in 21466us (21768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832901.594870:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 36 00000100:00100000:3.0:1788832901.598230:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832901.598329:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975419520 00000100:00100000:2.0:1788832901.598338:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975419520 00000100:00100000:2.0:1788832901.598404:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 26 00000100:00100000:2.0:1788832901.598413:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d033dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+38:10564:x1875726975419520:12345-192.168.206.41@tcp:35:lfs.0 00000004:00010000:2.0:1788832901.598470:0:5857:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a524f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5554e expref: 38 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832901.598763:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788832901.598814:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788832901.599111:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788832901.599163:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.599177:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a5209 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5552b expref: 42 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.599187:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.599218:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a5209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5552b expref: 42 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.599233:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a5209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5552b expref: 42 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832901.599248:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9fa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5857:1875726994309760:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832901.599330:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788832901.604453:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9fa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5857:1875726994309760:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832901.604482:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832901.605850:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832901.606086:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975419648 00000100:00100000:0.0:1788832901.606096:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975419648 00010000:00010000:0.0:1788832901.606134:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a5209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5552b expref: 43 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832901.606175:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 51 00000100:00100000:0.0:1788832901.606184:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+43:2357:x1875726975419648:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832901.606198:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832901.606204:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a5209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5552b expref: 43 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.606228:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a5209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5552b expref: 43 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.606260:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a5209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5552b expref: 43 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.606274:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d113e9000) 00010000:00010000:0.0:1788832901.606280:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.606299:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.606307:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.606335:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832901.606384:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+42:2357:x1875726975419648:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 201us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832901.606392:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 51 00010000:00010000:2.0:1788832901.606841:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.606851:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832901.606969:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788832901.607148:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788832901.607257:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9fa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1875726994309888:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788832901.607360:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832901.607392:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832901.608352:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994309888 00000100:00100000:0.0:1788832901.608362:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994309888 00000100:00100000:0.0:1788832901.608414:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832901.608422:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1875726994309888:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788832901.608505:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1875726994309888:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832901.608513:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788832901.608613:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832901.608657:0:5857:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788832901.608663:0:5857:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1788832901.608682:0:5857:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984d398fad80, transno 4294967301 00000100:00100000:1.0:1788832901.608694:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9fa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1875726994309888:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788832901.609157:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788832901.609227:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a573b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1875726994310016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788832901.609278:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832901.609292:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d11418480 going to sleep for 11 seconds 00000100:00100000:3.0:1788832901.609479:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994310016 00000100:00100000:3.0:1788832901.609484:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994310016 00000100:00100000:3.0:1788832901.609510:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788832901.609529:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5857:x1875726994310016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788832901.609688:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5857:x1875726994310016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 170us (409us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788832901.609696:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832901.614316:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a573b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1875726994310016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788832901.614409:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788832901.614468:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.614479:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.614497:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.614503:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832901.614508:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.614537:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.614552:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d113e9000) 00010000:00010000:1.0:1788832901.614555:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788832901.614560:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.614566:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5264 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788832901.614821:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788832901.614917:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788832901.614928:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 405305184032ns, next at 406305181891ns, rc = 0 00000001:00080000:1.0:1788832901.614935:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788832901.614968:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d113e9000) 00010000:00010000:1.0:1788832901.614971:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788832901.614977:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a524f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5554e expref: 46 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832901.615085:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d033dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+45:10564:x1875726975419520:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 16672us (16863us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788832901.615093:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 26 00000020:00080000:1.0:1788832901.615099:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788832901.619102:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832901.619176:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975419776 00000100:00100000:1.0:1788832901.619185:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975419776 00000100:00100000:1.0:1788832901.619243:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 100 00000100:00100000:1.0:1788832901.619253:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+45:10564:x1875726975419776:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832901.619297:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832901.619326:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a526b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55555 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.619380:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a526b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55555 expref: 46 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.619394:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a526b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55555 expref: 46 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.619412:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832901.619416:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832901.619420:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05600, rc 0) 00000100:00100000:1.0:1788832901.619482:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+46:10564:x1875726975419776:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 230us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832901.619489:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 100 00000100:00100000:0.0:1788832901.623336:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832901.623466:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975420032 00000100:00100000:1.0:1788832901.623477:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975420032 00000100:00100000:1.0:1788832901.623543:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 27 00000100:00100000:1.0:1788832901.623554:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+46:10564:x1875726975420032:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:1.0:1788832901.623816:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+47:10564:x1875726975420032:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 263us (486us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788832901.623824:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 27 00010000:00010000:0.0:1788832901.719447:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832901.732641:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832901.733429:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975420160 00000100:00100000:2.0:1788832901.733445:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975420160 00000100:00100000:2.0:1788832901.733578:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 101 00000100:00100000:2.0:1788832901.733590:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+47:10574:x1875726975420160:12345-192.168.206.41@tcp:34:lfs.0 00010000:00010000:2.0:1788832901.733710:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5272 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.733730:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.733769:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.733786:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5279 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.733794:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734081:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734193:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5280 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734202:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734209:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788832901.734273:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734289:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734296:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5272 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734303:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5272 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734324:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832901.734329:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5272 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734336:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5272 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734349:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:2.0:1788832901.734361:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832901.734366:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5272 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734373:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5272 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734388:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734393:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5279 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734398:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734403:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832901.734405:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734411:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5279 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734418:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d0c2cf300) 00010000:00010000:2.0:1788832901.734420:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832901.734423:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5279 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734429:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5279 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734444:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734456:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5280 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734463:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5280 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734468:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832901.734471:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5280 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734477:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5280 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734485:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:2.0:1788832901.734487:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832901.734490:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5280 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.734496:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5280 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832901.734624:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+47:10574:x1875726975420160:12345-192.168.206.41@tcp:34:lfs.0 Request processed in 1034us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832901.734634:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 101 00000100:00100000:3.0:1788832901.784221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832901.787545:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975420416 00000100:00100000:1.0:1788832901.787563:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975420416 00000100:00100000:1.0:1788832901.787646:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 102 00000100:00100000:1.0:1788832901.787656:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+47:10577:x1875726975420416:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832901.787689:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832901.787710:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5287 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5555c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.787799:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a528e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.787814:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a528e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.787825:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a528e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.787838:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5295 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.787845:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.787852:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.787965:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a529c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.787988:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a529c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.787996:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a529c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832901.788006:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788832901.788110:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a528e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788118:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a528e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788124:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a528e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788130:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832901.788134:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a528e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788141:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a528e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788153:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:1.0:1788832901.788156:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832901.788160:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a528e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788166:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a528e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788178:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788184:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5295 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788195:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5295 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788200:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832901.788522:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5295 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788529:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5295 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788591:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d02d42b00) 00010000:00010000:1.0:1788832901.788594:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832901.788606:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5295 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788612:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5295 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788653:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5287 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5555c expref: 50 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788667:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a529c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5555c expref: 49 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.788674:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832901.788676:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832901.788679:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04a00, rc 0) 00000100:00100000:1.0:1788832901.788848:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+49:10577:x1875726975420416:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 1090us (4539us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788832901.788856:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 102 00000100:00100000:1.0:1788832901.795442:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832901.795664:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975420544 00000100:00100000:0.0:1788832901.795677:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975420544 00000100:00100000:0.0:1788832901.795790:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 103 00000100:00100000:0.0:1788832901.795802:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+49:10577:x1875726975420544:12345-192.168.206.41@tcp:54:lfs.0 00010000:00010000:0.0:1788832901.795889:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.795911:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.795926:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.795959:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.795967:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.795975:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.795981:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bbe00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832901.795987:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.795995:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.796007:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:0.0:1788832901.796010:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788832901.796032:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.796039:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832901.796384:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+49:10577:x1875726975420544:12345-192.168.206.41@tcp:54:lfs.0 Request processed in 583us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832901.796394:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 103 00000100:00100000:0.0:1788832901.808542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832901.811886:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975420800 00000100:00100000:1.0:1788832901.811908:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975420800 00000100:00100000:1.0:1788832901.812007:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 28 00000100:00100000:1.0:1788832901.812162:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+49:10577:x1875726975420800:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:1.0:1788832901.812484:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+50:10577:x1875726975420800:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 325us (3955us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788832901.812493:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 28 00000100:00100000:3.0:1788832901.892366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832901.892470:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975421056 00000100:00100000:0.0:1788832901.892484:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975421056 00000100:00100000:0.0:1788832901.892625:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 104 00000100:00100000:0.0:1788832901.892639:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+50:10587:x1875726975421056:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:0.0:1788832901.892677:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832901.892682:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788832901.892716:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a522c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55540 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.892738:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:0.0:1788832901.892790:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832901.892807:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a52b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55563 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.892932:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.892948:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a529c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5555c expref: 50 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.892979:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.893083:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a529c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5555c expref: 50 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832901.893099:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a529c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5555c expref: 50 pid: 5855 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832901.893115:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b35d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994310144:192.168.206.41@tcp:104: 00000100:00100000:0.0:1788832901.894000:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aa53900 going to sleep for 11 seconds 00000100:00100000:3.0:1788832901.900126:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b35d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994310144:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832901.900190:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832901.902480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832901.902676:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975421184 00000100:00100000:2.0:1788832901.902689:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975421184 00010000:00010000:2.0:1788832901.902740:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a529c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5555c expref: 51 pid: 5855 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832901.902921:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 52 00000100:00100000:1.0:1788832901.902936:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+51:2358:x1875726975421184:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832901.902954:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832901.902962:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a529c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5555c expref: 51 pid: 5855 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.902978:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a529c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5555c expref: 51 pid: 5855 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.903006:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a529c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5555c expref: 51 pid: 5855 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.903026:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832901.903033:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.903044:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.903052:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.903082:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832901.903161:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+50:2358:x1875726975421184:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 228us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832901.903186:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 52 00010000:00010000:3.0:1788832901.903969:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.903981:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832901.904023:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788832901.905306:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a52b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55563 expref: 51 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.905342:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55563 expref: 50 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.905352:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:3.0:1788832901.905355:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832901.905359:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bbe00, rc 0) 00000100:00100000:3.0:1788832901.905449:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+50:10587:x1875726975421056:12345-192.168.206.41@tcp:101:bash.0 Request processed in 12812us (13096us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788832901.905459:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 104 00000100:00100000:3.0:1788832901.910424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832901.910608:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975421440 00000100:00100000:2.0:1788832901.910637:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975421440 00000100:00100000:2.0:1788832901.910710:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 105 00000100:00100000:2.0:1788832901.910722:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+50:10587:x1875726975421440:12345-192.168.206.41@tcp:36:bash.0 00010000:00010000:2.0:1788832901.911096:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a52c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.911116:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a52c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.911130:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a52c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832901.911273:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788832901.911304:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006caa118e reply state 00000000844772a2 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a52c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832901.911314:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832901.911432:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+53:10587:x1875726975421440:12345-192.168.206.41@tcp:36:bash.0 Request processed in 710us (1018us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788832901.911440:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 105 00000020:00080000:2.0:1788832901.911446:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788832901.916444:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00010000:00010000:1.0:1788832901.916552:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a52c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.916569:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a52c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.916580:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a52c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.916587:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832901.916593:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a52c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.916612:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a52c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.916636:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832901.916640:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832901.916645:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a52c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.916653:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a52c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832901.916738:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975421568 00000100:00100000:3.0:1788832901.916805:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975421568 00000100:00100000:3.0:1788832901.916875:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 106 00000100:00100000:3.0:1788832901.916887:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:10587:x1875726975421568:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:3.0:1788832901.916920:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832901.916942:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a52cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5556a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.917053:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.917069:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55563 expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.917101:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.917142:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55563 expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832901.917159:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55563 expref: 53 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832901.917176:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994310272:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832901.917284:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d036a7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788832901.923993:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832901.924963:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975421696 00000100:00100000:2.0:1788832901.924981:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975421696 00010000:00010000:2.0:1788832901.925038:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55563 expref: 54 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832901.925084:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 53 00000100:00100000:2.0:1788832901.925095:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:2357:x1875726975421696:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832901.925115:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832901.925123:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55563 expref: 54 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.925173:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55563 expref: 54 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.925203:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:2.0:1788832901.925210:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.925221:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.925230:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832901.925253:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832901.925330:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:2357:x1875726975421696:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 236us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832901.925338:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 53 00010000:00010000:1.0:1788832901.929378:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a52b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55563 expref: 53 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832901.929410:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994310272:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832901.929445:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.929493:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.929499:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832901.929563:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788832901.929568:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788832901.929593:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.929649:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a52cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5556a expref: 53 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.929666:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5556a expref: 52 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832901.929675:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832901.929678:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832901.929682:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3e00, rc 0) 00000100:00100000:1.0:1788832901.929800:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:10587:x1875726975421568:12345-192.168.206.41@tcp:101:bash.0 Request processed in 12913us (13368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832901.929809:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 106 00000100:00100000:0.0:1788832901.932834:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832901.932956:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975421952 00000100:00100000:1.0:1788832901.932970:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975421952 00000100:00100000:1.0:1788832901.933032:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 29 00000100:00100000:1.0:1788832901.933044:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:10587:x1875726975421952:12345-192.168.206.41@tcp:35:bash.0 00000100:00100000:1.0:1788832901.933728:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+53:10587:x1875726975421952:12345-192.168.206.41@tcp:35:bash.0 Request processed in 682us (904us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788832901.933777:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 29 00000100:00100000:0.0:1788832902.059239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832902.059319:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975422080 00000100:00100000:2.0:1788832902.059328:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975422080 00000100:00100000:2.0:1788832902.059401:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 107 00000100:00100000:2.0:1788832902.059411:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+53:10593:x1875726975422080:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832902.059442:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832902.059461:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a52db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55571 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.059521:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a52e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.059550:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a52e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.059561:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a52e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832902.059603:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788832902.059607:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788832902.059624:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a52e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.059647:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a52db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55571 expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.059665:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a52e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55571 expref: 54 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.059672:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:2.0:1788832902.059675:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832902.059679:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703e00, rc 0) 00000100:00100000:2.0:1788832902.059777:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:10593:x1875726975422080:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 334us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832902.059784:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 107 00000100:00080000:1.0:1788832902.060612:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832902.078205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832902.078416:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975422208 00000100:00100000:0.0:1788832902.078425:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975422208 00000100:00100000:0.0:1788832902.078479:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 108 00000100:00100000:0.0:1788832902.078488:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:10593:x1875726975422208:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788832902.078506:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832902.078524:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a52e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55578 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.078583:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a52f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.078610:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a52f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.078634:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a52f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.078647:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a52f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.078654:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a52f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.078659:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a52f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.078734:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a52fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.078780:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a52fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.078787:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a52fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832902.078817:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788832902.078820:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788832902.078835:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a52fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.078845:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a52fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.078853:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a52f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079316:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a52f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079323:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a52f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079329:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bae00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832902.079333:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a52f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079340:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a52f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079351:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:0.0:1788832902.079354:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832902.079359:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a52f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079365:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a52f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079378:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a52f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079384:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a52f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079390:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a52f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079395:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bba00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832902.079404:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a52f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079410:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a52f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079418:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d03c60b00) 00010000:00010000:0.0:1788832902.079420:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832902.079423:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a52f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079429:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a52f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079459:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a52e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55578 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079471:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a52fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55578 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.079478:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:0.0:1788832902.079480:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832902.079483:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036ba800, rc 0) 00000100:00100000:0.0:1788832902.079549:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:10593:x1875726975422208:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 1061us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832902.079557:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 108 00000100:00100000:3.0:1788832902.082717:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832902.082787:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832902.082893:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975422464 00000100:00100000:2.0:1788832902.082902:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975422464 00000100:00100000:2.0:1788832902.082952:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 109 00000100:00100000:2.0:1788832902.082961:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:10593:x1875726975422464:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832902.082989:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832902.083020:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5305 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5557f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.083111:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.083125:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5556a expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.083133:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a52fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55578 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.083141:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.083170:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a52fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55578 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.083183:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a52fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55578 expref: 56 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832902.083195:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994310400:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832902.083297:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5556a expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.083307:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5556a expref: 56 pid: 5855 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832902.083315:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3accdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994310528:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832902.083341:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a540 going to sleep for 11 seconds 00010000:00010000:2.0:1788832902.085570:0:5854:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.41@tcp) returned -22 from blocking AST (req@000000009546ec21 x1875726994310400) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a52fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55578 expref: 56 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.085592:0:5854:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a52fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55578 expref: 56 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.085625:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a52fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55578 expref: 56 pid: 5853 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832902.085640:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994310400:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832902.085653:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3accdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994310528:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832902.085674:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:2.0:1788832902.085679:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.085688:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.085696:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832902.087799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832902.092217:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975422592 00000100:00100000:1.0:1788832902.092232:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975422592 00000100:00100000:0.0:1788832902.092340:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975422720 00000100:00100000:0.0:1788832902.092344:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975422720 00010000:00010000:0.0:1788832902.092367:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5556a expref: 57 pid: 5855 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832902.092425:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 54 00000100:00100000:0.0:1788832902.092434:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:2358:x1875726975422720:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832902.092448:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832902.092455:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5556a expref: 57 pid: 5855 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.092468:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5556a expref: 57 pid: 5855 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.092490:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a52d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5556a expref: 57 pid: 5855 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.092506:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:0.0:1788832902.092512:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.092521:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.092529:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.092552:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832902.092616:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+56:2358:x1875726975422720:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 183us (4824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832902.092624:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 54 00000100:00100000:0.0:1788832902.092641:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:0.0:1788832902.092653:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:2357:x1875726975422592:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832902.092662:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832902.092664:0:5839:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d270a10c1c6a52fe) 00010000:00010000:0.0:1788832902.092666:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832902.092683:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:2357:x1875726975422592:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 31us (9896us total) trans 0 rc 116/116 00000100:00100000:0.0:1788832902.092689:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 7 00010000:00010000:3.0:1788832902.092830:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.092839:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832902.092873:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788832902.092997:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5305 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5557f expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.093012:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5557f expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.093031:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:3.0:1788832902.093035:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832902.093037:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702400, rc 0) 00000100:00100000:3.0:1788832902.093061:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:10593:x1875726975422464:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 10101us (10352us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788832902.093067:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 109 00000100:00100000:3.0:1788832902.095096:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832902.095233:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975422976 00000100:00100000:2.0:1788832902.095241:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975422976 00000100:00100000:2.0:1788832902.095291:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:2.0:1788832902.095300:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:10593:x1875726975422976:12345-192.168.206.41@tcp:103:lfs.0 00010000:00010000:2.0:1788832902.095324:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832902.095344:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a526b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55555 expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.095359:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:2.0:1788832902.095363:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832902.095403:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:10593:x1875726975422976:12345-192.168.206.41@tcp:103:lfs.0 Request processed in 104us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832902.095410:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:3.0:1788832902.113030:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832902.113691:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975423104 00000100:00100000:1.0:1788832902.113701:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975423104 00000100:00100000:1.0:1788832902.113785:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 110 00000100:00100000:1.0:1788832902.113795:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:10593:x1875726975423104:12345-192.168.206.41@tcp:58:lfs.0 00010000:00010000:1.0:1788832902.113903:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a531a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832902.113918:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a531a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832902.113929:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a531a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788832902.114102:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788832902.114194:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:10593:x1875726975423104:12345-192.168.206.41@tcp:58:lfs.0 Request processed in 400us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832902.114202:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 110 00000100:00100000:2.0:1788832902.116281:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832902.116359:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975423232 00000100:00100000:3.0:1788832902.116376:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975423232 00000100:00100000:3.0:1788832902.116453:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 111 00000100:00100000:3.0:1788832902.116466:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:10593:x1875726975423232:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:3.0:1788832902.116492:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832902.116529:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a5321 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55586 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.116613:0:7174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a531a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.116626:0:7174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a5321 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55586 expref: 55 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.116650:0:7174:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a531a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.116664:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a5321 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55586 expref: 55 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.116701:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:3.0:1788832902.116705:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832902.116710:0:7174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a5321 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55586 expref: 55 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.116718:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2000, rc 0) 00000100:00100000:3.0:1788832902.116827:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:10593:x1875726975423232:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 364us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832902.116836:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 111 00000004:00080000:2.0:1788832902.293946:0:7729:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 405984199936ns, next at 406984197885ns, rc = 0 00000100:00100000:1.0:1788832902.294036:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832902.294056:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3accf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994310656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832902.294121:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832902.294359:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994310656 00000100:00100000:2.0:1788832902.294368:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994310656 00000100:00100000:2.0:1788832902.294963:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788832902.294987:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875726994310656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832902.295020:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788832902.295087:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875726994310656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832902.295098:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788832902.295145:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994310912:0@lo:400:kworker.0 00000100:00100000:2.0:1788832902.295158:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994311168:0@lo:400:kworker.0 00000100:00100000:2.0:1788832902.295222:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832902.295271:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832902.295279:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994311040:0@lo:400:kworker.0 00000100:00100000:0.0:1788832902.295306:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994310784:0@lo:400:kworker.0 00000100:00100000:2.0:1788832902.295316:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832902.295355:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994311168 00000100:00100000:2.0:1788832902.295360:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994311168 00000100:00100000:0.0:1788832902.295372:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832902.295446:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994310784 00000100:00100000:0.0:1788832902.295454:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994310784 00000100:00100000:0.0:1788832902.295498:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788832902.295507:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994310784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832902.295573:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994310784:12345-0@lo:400:kworker.0 Request processed in 67us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832902.295582:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788832902.295651:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994310784:0@lo:400:kworker.0 00000100:00100000:0.0:1788832902.295716:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3accf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994310656:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788832902.298148:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832902.298280:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994311040 00000100:00100000:1.0:1788832902.298290:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994311040 00000100:00080000:0.0:1788832902.298390:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832902.298395:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832902.298676:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832902.305404:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788832902.305428:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994311040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832902.305496:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994310912 00000100:00100000:1.0:1788832902.305505:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994310912 00000100:00100000:1.0:1788832902.305552:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788832902.305560:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3acce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994311168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832902.305723:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994311168:0@lo:400:kworker.0 00000100:00100000:2.0:1788832902.305798:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994311040:12345-0@lo:400:kworker.0 Request processed in 382us (10488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832902.305805:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788832902.305835:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994311040:0@lo:400:kworker.0 00000100:00100000:2.0:1788832902.305854:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788832902.305871:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994310912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832902.305923:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994310912:12345-0@lo:400:kworker.0 Request processed in 63us (7255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832902.305928:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788832902.305967:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994310912:0@lo:400:kworker.0 00000100:00100000:1.0:1788832902.306114:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3acce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994311168:12345-0@lo:400:kworker.0 Request processed in 555us (10893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832902.306121:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788832902.492314:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832902.492376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832902.492409:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832902.492479:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832902.492542:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975423616 00000100:00100000:1.0:1788832902.492560:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975423616 00000100:00100000:3.0:1788832902.492562:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975423744 00000100:00100000:3.0:1788832902.492573:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975423744 00000100:00100000:0.0:1788832902.492618:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975423488 00000100:00100000:0.0:1788832902.492626:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975423488 00000100:00100000:2.0:1788832902.492676:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975423360 00000100:00100000:2.0:1788832902.492685:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975423360 00000100:00100000:1.0:1788832902.492691:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 61 00000100:00100000:1.0:1788832902.492704:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2360:x1875726975423616:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832902.492813:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 289 00000100:00100000:0.0:1788832902.492821:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 62 00000100:00100000:2.0:1788832902.492833:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2360:x1875726975423360:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832902.492844:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2360:x1875726975423488:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832902.492855:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2360:x1875726975423616:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 152us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832902.492864:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 61 00000100:00100000:0.0:1788832902.492899:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2360:x1875726975423488:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 65us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832902.492923:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2360:x1875726975423360:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 90us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832902.492933:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 62 00000100:00100000:2.0:1788832902.492942:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 289 00000100:00100000:3.0:1788832902.498077:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 138 00000100:00100000:3.0:1788832902.498099:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975423744:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832902.498300:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975423744:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 207us (5820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832902.498308:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 138 00000100:00080000:2.0:1788832902.498672:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832902.498679:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788832902.742026:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788832902.806840:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832902.806849:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832902.806888:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788832902.806895:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832902.807776:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b35c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875726994311296:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832902.809124:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b02540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832902.823613:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b35c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875726994311296:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832902.825959:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832902.826303:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975423872 00000100:00100000:3.0:1788832902.826312:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975423872 00000100:00100000:3.0:1788832902.826368:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 112 00000100:00100000:3.0:1788832902.826390:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:10594:x1875726975423872:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788832902.826420:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788832902.826530:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:10594:x1875726975423872:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 Request processed in 142us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832902.826538:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 112 00000100:00100000:1.0:1788832902.832167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832902.832252:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975424000 00000100:00100000:3.0:1788832902.832261:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975424000 00000100:00100000:3.0:1788832902.832383:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 113 00000100:00100000:3.0:1788832902.832394:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:10594:x1875726975424000:12345-192.168.206.41@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788832902.832456:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5328 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832472:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5328 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832483:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5328 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832498:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a532f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832505:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a532f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832523:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a532f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832544:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5336 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832566:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832573:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832902.832616:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788832902.832621:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788832902.832632:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832641:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5328 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832648:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5328 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832655:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5328 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832661:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832902.832665:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5328 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832672:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5328 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832682:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d02d42000) 00010000:00010000:3.0:1788832902.832685:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832902.832688:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5328 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832703:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5328 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832715:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a532f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832720:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a532f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832726:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a532f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832731:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832902.832734:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a532f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.832739:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a532f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.833111:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff984d113e9000) 00010000:00010000:3.0:1788832902.833113:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832902.833117:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a532f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.833122:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a532f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.833138:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.833144:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5336 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.833157:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.833163:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832902.833166:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.833171:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5336 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.833179:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:3.0:1788832902.833181:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832902.833184:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5336 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.833189:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5336 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832902.833287:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:10594:x1875726975424000:12345-192.168.206.41@tcp:34:lhsmtool_posix.0 Request processed in 894us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832902.833295:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 113 00000100:00100000:3.0:1788832902.836036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832902.836066:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975424256 00000100:00100000:0.0:1788832902.836076:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975424256 00000100:00100000:2.0:1788832902.836192:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 114 00000100:00100000:2.0:1788832902.836208:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:10594:x1875726975424256:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832902.836239:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832902.836257:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a533d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5558d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.836359:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5344 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.836374:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.836384:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832902.836395:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788832902.836481:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.836489:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5344 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.836495:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.836501:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832902.836505:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.836512:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5344 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.836838:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:2.0:1788832902.836848:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788832902.836854:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5344 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.836861:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5344 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.836900:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a533d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5558d expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.836910:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d02d42000) 00010000:00010000:2.0:1788832902.836913:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832902.836917:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a533d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5558d expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.836927:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702600, rc 0) 00000100:00100000:2.0:1788832902.836975:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+56:10594:x1875726975424256:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 771us (946us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788832902.836982:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 114 00000100:00100000:0.0:1788832902.839463:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832902.839633:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975424384 00000100:00100000:1.0:1788832902.839642:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975424384 00000100:00100000:1.0:1788832902.839730:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 115 00000100:00100000:1.0:1788832902.839740:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+56:10594:x1875726975424384:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788832902.839799:0:5855:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788832902.839941:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+56:10594:x1875726975424384:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 Request processed in 201us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832902.839949:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 115 00000100:00100000:1.0:1788832902.852255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832902.852688:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975424640 00000100:00100000:3.0:1788832902.852698:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975424640 00000100:00100000:3.0:1788832902.852843:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 116 00000100:00100000:3.0:1788832902.852864:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+56:10594:x1875726975424640:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832902.852885:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832902.852888:0:7174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788832902.852913:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a52e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55571 expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.852944:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:3.0:1788832902.852949:0:7174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832902.852963:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5352 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55594 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788832902.853331:0:7174:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788832902.853844:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.853858:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.853868:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.853926:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5352 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55594 expref: 58 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.853941:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55594 expref: 57 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.853948:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff984d113e9000) 00010000:00010000:3.0:1788832902.853951:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832902.853954:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3e00, rc 0) 00000100:00100000:3.0:1788832902.854021:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:10594:x1875726975424640:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 1168us (1773us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788832902.854029:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 116 00000100:00100000:2.0:1788832902.858100:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832902.858403:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975424896 00000100:00100000:3.0:1788832902.858413:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975424896 00000100:00100000:3.0:1788832902.858499:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 117 00000100:00100000:3.0:1788832902.858519:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3accf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:10594:x1875726975424896:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788832902.858619:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832902.858644:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55594 expref: 57 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.858663:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff984d113e9000) 00010000:00010000:3.0:1788832902.858677:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832902.858698:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5367 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.858711:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5367 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.858720:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5367 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.858768:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a536e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x821bf92a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.858776:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a536e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x821bf92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.858783:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a536e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x821bf92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861344:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5367 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861361:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5367 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861369:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5367 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861374:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832902.861396:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5367 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861405:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5367 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861423:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:2.0:1788832902.861427:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832902.861431:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5367 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861437:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5367 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861452:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a536e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x821bf92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861458:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a536e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x821bf92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861463:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a536e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x821bf92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861469:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832902.861472:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a536e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x821bf92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861477:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a536e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x821bf92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861485:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x821bf92a (ffff984d113e9600) 00010000:00010000:2.0:1788832902.861487:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832902.861500:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a536e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x821bf92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.861506:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a536e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x821bf92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832902.861631:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3accf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+56:10594:x1875726975424896:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 3111us (3535us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788832902.861640:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 117 00000100:00100000:1.0:1788832902.866927:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832902.870973:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975425024 00000100:00100000:2.0:1788832902.870987:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975425024 00000100:00100000:0.0:1788832902.873589:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 118 00000100:00100000:0.0:1788832902.873617:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+56:10594:x1875726975425024:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788832902.873638:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832902.873660:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a5375 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5559b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.873693:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a537c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.873706:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a537c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.873716:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a537c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.873987:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a5375 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5559b expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.874250:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a537c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5559b expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.874414:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:0.0:1788832902.874417:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788832902.874420:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036ba400, rc 0) 00000100:00100000:0.0:1788832902.874617:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:10594:x1875726975425024:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 1002us (7697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832902.874626:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 118 00000100:00100000:1.0:1788832902.880669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832902.880783:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975425280 00000100:00100000:2.0:1788832902.880793:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975425280 00000100:00100000:2.0:1788832902.880843:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 119 00000100:00100000:2.0:1788832902.880852:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:10594:x1875726975425280:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788832902.880951:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5383 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.880968:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5383 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832902.880980:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5383 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788832902.881222:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1788832902.881310:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083267a22 reply state 00000000c67b05ab transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5383 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832902.881331:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832902.881423:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:10594:x1875726975425280:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 570us (761us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788832902.881441:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 119 00010000:00010000:1.0:1788832902.884439:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5383 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832902.884475:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5383 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832902.884482:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5383 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832902.884488:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832902.884492:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5383 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832902.884500:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5383 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832902.884528:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:1.0:1788832902.884531:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788832902.884536:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5383 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832902.884542:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5383 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832902.885553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832902.885688:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975425408 00000100:00100000:3.0:1788832902.885699:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975425408 00000100:00100000:3.0:1788832902.885780:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 120 00000100:00100000:3.0:1788832902.885802:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+58:10594:x1875726975425408:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832902.885825:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832902.885842:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a538a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555a2 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.885902:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a538a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555a2 expref: 59 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.885918:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a538a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555a2 expref: 59 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.885935:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:3.0:1788832902.885938:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832902.885942:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3e00, rc 0) 00000100:00100000:3.0:1788832902.886211:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:10594:x1875726975425408:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 411us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832902.886219:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 120 00000100:00100000:3.0:1788832902.895836:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832902.896126:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975425536 00000100:00100000:1.0:1788832902.896136:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975425536 00000100:00100000:1.0:1788832902.896192:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 37 00000100:00100000:1.0:1788832902.896202:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2357:x1875726975425536:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788832902.896681:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2357:x1875726975425536:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 Request processed in 479us (852us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788832902.896689:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 37 00000100:00100000:1.0:1788832902.902784:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832902.904008:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975425792 00000100:00100000:2.0:1788832902.904020:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975425792 00000100:00100000:2.0:1788832902.904082:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 30 00000100:00100000:2.0:1788832902.904091:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:10594:x1875726975425792:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788832902.904308:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+60:10594:x1875726975425792:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 218us (1563us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788832902.904323:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 30 00000100:00100000:2.0:1788832902.907566:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832902.913025:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975426048 00000100:00100000:1.0:1788832902.913039:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975426048 00000100:00100000:1.0:1788832902.913114:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 121 00000100:00100000:1.0:1788832902.913124:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+60:10594:x1875726975426048:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788832902.913287:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+60:10594:x1875726975426048:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 164us (5728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832902.913305:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 121 00000100:00100000:3.0:1788832902.923697:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832902.924632:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975426176 00000100:00100000:0.0:1788832902.924643:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975426176 00000100:00100000:0.0:1788832902.924708:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 122 00000100:00100000:0.0:1788832902.924719:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+60:10594:x1875726975426176:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788832902.924738:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832902.924837:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5391 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555a9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.924964:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5398 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.924979:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.924991:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832902.925037:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788832902.925055:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.925079:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5391 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555a9 expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.925094:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5398 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555a9 expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.925102:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:0.0:1788832902.925105:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788832902.925109:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036ba000, rc 0) 00000100:00100000:0.0:1788832902.925169:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:10594:x1875726975426176:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 452us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832902.925177:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 122 00000100:00100000:0.0:1788832902.930161:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832902.930313:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975426304 00000100:00100000:3.0:1788832902.930331:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975426304 00000100:00100000:3.0:1788832902.930535:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 38 00000100:00100000:3.0:1788832902.930545:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2357:x1875726975426304:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832902.930562:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832902.930582:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a539f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555b0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832902.930637:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f6c87, blocks: 0x1 00010000:00010000:3.0:1788832902.930657:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1788832902.930661:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832902.930670:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a539f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b0 expref: 10 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.930686:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a539f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b0 expref: 10 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.930698:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3800, rc 0) 00000100:00100000:3.0:1788832902.930839:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:2357:x1875726975426304:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 295us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832902.930847:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 38 00000100:00100000:2.0:1788832902.940580:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832902.947239:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975426560 00000100:00100000:1.0:1788832902.947252:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975426560 00000100:00100000:1.0:1788832902.948463:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 123 00000100:00100000:1.0:1788832902.948481:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:10594:x1875726975426560:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788832902.949233:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:10594:x1875726975426560:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 754us (8658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832902.949241:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 123 00000100:00100000:1.0:1788832902.968159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832902.968233:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975426688 00000100:00100000:3.0:1788832902.968242:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975426688 00000100:00100000:3.0:1788832902.968356:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 39 00000100:00100000:3.0:1788832902.968367:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:10594:x1875726975426688:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832902.968384:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832902.968402:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a53a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555b7 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.968430:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a539f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b0 expref: 11 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.968455:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832902.968459:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832902.968465:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a53a6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b7 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.968499:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a539f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b0 expref: 11 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832902.968512:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a539f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b0 expref: 11 pid: 6700 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832902.968526:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1875726994311424:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832902.968632:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d036a7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788832902.973513:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1875726994311424:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832902.973551:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a53a6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b7 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832902.973573:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2200, rc 0) 00000100:00100000:1.0:1788832902.973767:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:10594:x1875726975426688:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 5380us (5593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832902.973775:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 39 00000100:00100000:3.0:1788832902.977014:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832902.977618:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975426816 00000100:00100000:0.0:1788832902.977628:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975426816 00010000:00010000:0.0:1788832902.977667:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a539f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b0 expref: 11 pid: 6700 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832902.977817:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 55 00000100:00100000:0.0:1788832902.977826:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:2358:x1875726975426816:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832902.977840:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832902.977874:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a539f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b0 expref: 11 pid: 6700 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.977902:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a539f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b0 expref: 11 pid: 6700 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.977923:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a539f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b0 expref: 11 pid: 6700 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.977940:0:7639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832902.977945:0:7639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832902.977953:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a53a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b7 expref: 10 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.977962:0:7639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a53a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b7 expref: 10 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832902.979313:0:7639:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a53a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b7 expref: 10 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832902.979441:0:7639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b35d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7639:1875726994311552:192.168.206.41@tcp:105: 00000100:00100000:0.0:1788832902.979546:0:7639:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b02540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832902.984950:0:7639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b35d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7639:1875726994311552:192.168.206.41@tcp:105: 00010000:00010000:0.0:1788832902.985026:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832902.985125:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:2358:x1875726975426816:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 7298us (8117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832902.985135:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 55 00000100:00100000:3.0:1788832902.989113:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832902.989772:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975426944 00000100:00100000:1.0:1788832902.989795:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975426944 00002000:00100000:1.0:1788832902.990672:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff984d3b7f5180 x1875726975426944/t0(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:88/0 lens 504/0 e 0 to 0 dl 1788832913 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832902.990683:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3b7f5180 with x1875726975426944 ext(0->12) 00002000:00010000:1.0:1788832902.990688:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984d3b7f5180 00000100:00100000:1.0:1788832902.990727:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 2 00000100:00100000:1.0:1788832902.990736:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:2357:x1875726975426944:12345-192.168.206.41@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788832902.993264:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:2357:x1875726975426944:12345-192.168.206.41@tcp:4:lhsmtool_posix.0 Request processed in 2520us (4150us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788832902.993276:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 2 00002000:00100000:1.0:1788832902.993286:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff984d3b7f5180 x1875726975426944/t4294967308(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:88/0 lens 504/448 e 0 to 0 dl 1788832913 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832902.993297:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3b7f5180 with x1875726975426944 ext(0->12) 00002000:00010000:1.0:1788832902.993303:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984d3b7f5180 00000100:00100000:3.0:1788832903.008684:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832903.009175:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975427072 00000100:00100000:0.0:1788832903.009184:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975427072 00000100:00100000:0.0:1788832903.009246:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 124 00000100:00100000:0.0:1788832903.009255:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:10594:x1875726975427072:12345-192.168.206.41@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788832903.101003:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:10594:x1875726975427072:12345-192.168.206.41@tcp:44:lhsmtool_posix.0 Request processed in 91729us (92308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832903.101016:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 124 00000001:00080000:3.0:1788832903.102410:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967365 is committed 00000001:00080000:3.0:1788832903.102426:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967395 is committed 00000004:00080000:3.0:1788832903.102440:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788832903.102467:0:5875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984d11418540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788832903.102472:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d3bd01700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984d114183c0 00000020:00080000:3.0:1788832903.102475:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d3bd01400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984d3b9c1400 00000004:00080000:3.0:1788832903.102490:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:3.0:1788832903.102528:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788832903.102552:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788832903.102577:0:5875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984d06d8a840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788832903.102580:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d3a116f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984d06d8ae40 00000020:00080000:3.0:1788832903.102583:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d3a116600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984d3acdd800 00000020:00080000:3.0:1788832903.102626:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788832903.102845:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788832903.103463:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994311680:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788832903.103535:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832903.103613:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832903.103620:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994311808:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788832903.103647:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832903.103685:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994311680 00000100:00100000:2.0:1788832903.103692:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994311680 00000100:00100000:2.0:1788832903.103737:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994311808 00000100:00100000:2.0:1788832903.103740:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994311808 00000100:00100000:2.0:1788832903.103785:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788832903.103793:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875726994311680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788832903.103829:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1788832903.103872:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f6c85, atime: 0x6a9f6c85, ctime: 0x6a9f6c85, blocks: 0x1 00010000:00010000:2.0:1788832903.103880:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a53ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.103909:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=406s v=(0 0) 00010000:00010000:2.0:1788832903.103913:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832903.103920:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a53ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.103936:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a53ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.103946:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a53ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.103954:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a53ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.103971:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788832903.104631:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1875726994311680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 837us (1094us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788832903.104639:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788832903.104657:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788832903.104664:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1817d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875726994311808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788832903.104675:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1788832903.104688:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.104704:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a516f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55516 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.104718:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788832903.104722:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832903.104726:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.104773:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a516f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55516 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.104786:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a516f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55516 expref: 11 pid: 6699 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832903.104799:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1875726994311936:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832903.104872:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788832903.104895:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832903.104900:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a53ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.104907:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703a00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788832903.104911:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a53ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.104919:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a53ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.104947:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a53ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.104954:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a53ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.104972:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832903.104974:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832903.104975:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788832903.105870:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984d3b717100/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788832903.105880:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994311680:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1788832903.105900:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832903.110416:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1875726994311936:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832903.110446:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832903.113394:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832903.113481:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975427200 00000100:00100000:2.0:1788832903.113490:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975427200 00000100:00100000:2.0:1788832903.113548:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 42 00000100:00100000:2.0:1788832903.113557:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:2357:x1875726975427200:12345-192.168.206.41@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788832903.119887:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832903.119924:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975427328 00000100:00100000:2.0:1788832903.119933:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975427328 00010000:00010000:2.0:1788832903.119967:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a516f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55516 expref: 13 pid: 6699 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832903.120033:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 56 00000100:00100000:2.0:1788832903.120043:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:2358:x1875726975427328:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832903.120057:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832903.120063:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a516f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55516 expref: 13 pid: 6699 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.120076:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a516f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55516 expref: 13 pid: 6699 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.120097:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001275551a/0xd270a10c1c6a516f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55516 expref: 13 pid: 6699 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.120113:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832903.120117:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832903.120122:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.120131:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.120453:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832903.120496:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:2358:x1875726975427328:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 455us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832903.120503:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 56 00010000:00010000:2.0:1788832903.120643:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.120653:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.120662:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.120670:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.120687:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788832903.122272:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1817d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1875726994311808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17604us (18619us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788832903.122283:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1788832903.122452:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832903.122460:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.122471:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702a00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788832903.122475:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.122484:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.123376:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.123390:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4d46840/0xd270a10c1c6a53b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.123415:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832903.123417:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832903.123419:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788832903.123475:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984d3b717b80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788832903.123494:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994311808:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788832903.183171:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:2357:x1875726975427200:12345-192.168.206.41@tcp:16:lhsmtool_posix.0 Request processed in 69604us (69775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832903.183184:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 42 00000001:00080000:1.0:1788832903.187649:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1788832903.187683:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788832903.191082:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832903.191244:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975427584 00000100:00100000:3.0:1788832903.191254:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975427584 00000100:00100000:1.0:1788832903.191500:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 125 00000100:00100000:1.0:1788832903.191623:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:10594:x1875726975427584:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788832903.191673:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832903.191696:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5398 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555a9 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.191724:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:1.0:1788832903.191729:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832903.191836:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a53bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.191850:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a53bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.191859:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a53bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832903.192106:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d52bb07 reply state 00000000e398ff0d transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a53bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832903.192119:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832903.192299:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:10594:x1875726975427584:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 789us (1224us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788832903.192317:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 125 00010000:00010000:1.0:1788832903.195852:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a53bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.195868:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a53bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.195876:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a53bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.195881:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832903.195886:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a53bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.195905:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a53bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.195920:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:1.0:1788832903.195923:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832903.195927:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a53bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.195932:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a53bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832903.200485:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832903.201290:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975427712 00000100:00100000:1.0:1788832903.201300:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975427712 00000100:00100000:1.0:1788832903.201698:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 43 00000100:00100000:1.0:1788832903.201711:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2357:x1875726975427712:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788832903.201922:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788832903.201926:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788832902 00002000:00010000:1.0:1788832903.201928:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788832901 00002000:00010000:1.0:1788832903.201930:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788832903 -> 1788832902 00002000:00010000:1.0:1788832903.201932:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788832903.201999:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975427712:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 Request processed in 284us (1515us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788832903.202007:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 43 00000100:00100000:2.0:1788832903.205583:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832903.206962:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975427968 00000100:00100000:3.0:1788832903.206973:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975427968 00000100:00100000:3.0:1788832903.207047:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 126 00000100:00100000:3.0:1788832903.207056:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:10594:x1875726975427968:12345-192.168.206.41@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788832903.207114:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.207128:0:7174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a537c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5559b expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.207138:0:7174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.207269:0:7174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a537c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5559b expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.207283:0:7174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a537c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5559b expref: 15 pid: 5853 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832903.207308:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994312064:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832903.207453:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b023c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832903.214966:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994312064:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832903.214996:0:7174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832903.217651:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832903.222130:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975428096 00000100:00100000:0.0:1788832903.222144:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975428096 00010000:00010000:0.0:1788832903.222252:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a537c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5559b expref: 16 pid: 5853 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832903.222354:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 57 00000100:00100000:0.0:1788832903.222364:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:2358:x1875726975428096:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832903.222378:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832903.222384:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a537c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5559b expref: 16 pid: 5853 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.222398:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a537c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5559b expref: 16 pid: 5853 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.222418:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a537c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5559b expref: 16 pid: 5853 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.222434:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:0.0:1788832903.222438:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.222447:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.222468:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.222502:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832903.222568:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:2358:x1875726975428096:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 205us (4923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832903.222575:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 57 00010000:00010000:3.0:1788832903.222644:0:7174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.222652:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.222680:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.222687:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.222693:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.222699:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832903.222703:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.222710:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.222719:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:3.0:1788832903.222722:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788832903.222726:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.222732:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832903.222805:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:10594:x1875726975427968:12345-192.168.206.41@tcp:55:lhsmtool_posix.0 Request processed in 15749us (17228us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788832903.222813:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 126 00000100:00100000:0.0:1788832903.231408:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832903.231551:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975428224 00000100:00100000:2.0:1788832903.231560:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975428224 00000100:00100000:2.0:1788832903.231621:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 44 00000100:00100000:2.0:1788832903.231631:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2360:x1875726975428224:12345-192.168.206.41@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788832903.231672:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.231693:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a53a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b7 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.231719:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832903.231724:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832903.231729:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.231805:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a53a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b7 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.231819:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a53a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b7 expref: 7 pid: 6699 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832903.231834:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1875726994312192:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832903.231924:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832903.236695:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1875726994312192:192.168.206.41@tcp:104: 00010000:00010000:0.0:1788832903.236727:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832903.241602:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832903.241796:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975428352 00000100:00100000:2.0:1788832903.241806:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975428352 00010000:00010000:2.0:1788832903.241844:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a53a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b7 expref: 8 pid: 6699 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832903.241900:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 58 00000100:00100000:2.0:1788832903.241910:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2357:x1875726975428352:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832903.241927:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832903.241949:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a53a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b7 expref: 8 pid: 6699 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.241983:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a53a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b7 expref: 8 pid: 6699 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.242017:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a53a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555b7 expref: 8 pid: 6699 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.242033:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832903.242037:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832903.242043:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.242056:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.242085:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832903.242145:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975428352:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 235us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832903.242604:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 58 00010000:00010000:3.0:1788832903.243682:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.243696:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.243726:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.243734:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.243777:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.243785:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702000 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788832903.243789:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.243798:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.243832:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.243840:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc213812/0xd270a10c1c6a53c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832903.244129:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975428224:12345-192.168.206.41@tcp:1:lhsmtool_posix.0 Request processed in 12496us (12727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832903.244138:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 44 00000100:00100000:0.0:1788832903.252863:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832903.253079:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975428608 00000100:00100000:3.0:1788832903.253088:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975428608 00000100:00100000:3.0:1788832903.253143:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 127 00000100:00100000:3.0:1788832903.253160:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:10594:x1875726975428608:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788832903.253229:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.253245:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.253256:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.253623:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.253635:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a538a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555a2 expref: 15 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.253658:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.253688:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a538a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555a2 expref: 15 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.253702:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a538a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555a2 expref: 15 pid: 7174 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832903.253715:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994312320:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832903.253836:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b02540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832903.262951:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994312320:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832903.262979:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832903.268828:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832903.269250:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975428736 00000100:00100000:1.0:1788832903.269260:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975428736 00010000:00010000:1.0:1788832903.269294:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a538a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555a2 expref: 16 pid: 7174 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832903.269340:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 59 00000100:00100000:1.0:1788832903.269350:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:2357:x1875726975428736:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832903.269363:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832903.269369:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a538a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555a2 expref: 16 pid: 7174 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.269383:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a538a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555a2 expref: 16 pid: 7174 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.269403:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a538a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555a2 expref: 16 pid: 7174 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.269418:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:1.0:1788832903.269423:0:7639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.269431:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.269438:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.269466:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832903.269529:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:2357:x1875726975428736:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 180us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832903.269537:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 59 00010000:00010000:3.0:1788832903.269672:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832903.269680:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788832903.270698:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788832903.273132:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788832903.273394:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788832903.273480:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b715f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5854:1875726994312448:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788832903.273543:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832903.273582:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d11418c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832903.273935:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994312448 00000100:00100000:3.0:1788832903.273943:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994312448 00000100:00100000:3.0:1788832903.274063:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788832903.274073:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5854:x1875726994312448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788832903.274306:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5854:x1875726994312448:12345-0@lo:1000:mdt00_001.0 Request processed in 77us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832903.274328:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832903.274717:0:5854:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788832903.274724:0:5854:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1788832903.274762:0:5854:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff984d3b717b80 x1875726994311808/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788832919 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832903.274775:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b715f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5854:1875726994312448:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788832903.278239:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788832903.278369:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b715f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5854:1875726994312576:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788832903.278447:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832903.278482:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d11418f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832903.279961:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994312576 00000100:00100000:0.0:1788832903.279973:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994312576 00000100:00100000:0.0:1788832903.280027:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788832903.280037:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5854:x1875726994312576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788832903.280277:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5854:x1875726994312576:12345-0@lo:1000:mdt00_001.0 Request processed in 241us (1830us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788832903.280285:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788832903.280835:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b715f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5854:1875726994312576:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788832903.280882:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.280897:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.280905:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.280911:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832903.280929:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.280937:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.280952:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:1.0:1788832903.280955:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832903.280960:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.280966:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a53d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.280995:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a531a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.281002:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a531a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.281007:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a531a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.281013:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832903.281016:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a531a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.281021:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a531a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.281028:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832903.281031:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832903.281042:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a5321 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55586 expref: 18 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.281054:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a5321 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55586 expref: 18 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.281062:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a5321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55586 expref: 18 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.281095:0:5854:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a5321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55586 expref: 18 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832903.281108:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994312704:192.168.206.41@tcp:105: 00000100:00100000:1.0:1788832903.281189:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d11418f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832903.288186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832903.288306:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994312704:192.168.206.41@tcp:105: 00010000:00010000:1.0:1788832903.288346:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a531a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288357:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a531a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288387:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a53de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288400:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a53de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288410:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a53de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288436:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a53de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288448:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a53de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288455:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a53de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288464:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832903.288468:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a53de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288475:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a53de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288486:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832903.288489:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832903.288493:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a53de lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288627:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a53de lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288637:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288642:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288648:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288663:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832903.288666:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288672:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288679:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832903.288682:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788832903.288685:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.288690:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a53d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832903.289109:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:10594:x1875726975428608:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 35948us (36257us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788832903.289119:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 127 00000020:00080000:1.0:1788832903.289125:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788832903.289740:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975428864 00000100:00100000:2.0:1788832903.289774:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975428864 00000100:00100000:2.0:1788832903.289825:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 31 00000100:00100000:2.0:1788832903.289834:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:10593:x1875726975428864:12345-192.168.206.41@tcp:49:lfs.0 00000100:00100000:2.0:1788832903.289932:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:10593:x1875726975428864:12345-192.168.206.41@tcp:49:lfs.0 Request processed in 100us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832903.289939:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 31 00000040:00080000:0.0:1788832903.291274:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832903.291281:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832903.291782:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788832903.291868:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788832903.295489:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832903.295566:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975429120 00000100:00100000:1.0:1788832903.295576:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975429120 00000100:00100000:1.0:1788832903.295639:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 32 00000100:00100000:1.0:1788832903.295648:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d033ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:10594:x1875726975429120:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788832903.297458:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788832903.297565:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788832903.299296:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a53e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.299316:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a53e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.299327:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a53e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.299334:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a53e5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.299341:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a53e5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.299347:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a53e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.299375:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788832903.299538:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d033ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:10594:x1875726975429120:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 3887us (4054us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788832903.299548:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 32 00000020:00080000:0.0:1788832903.299553:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788832903.299793:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832903.299801:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a53e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.299812:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba400 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788832903.299817:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a53e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.299824:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a53e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.299837:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff984d03c60600) 00010000:00010000:2.0:1788832903.299840:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788832903.299844:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a53e5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.299859:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a53e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.299876:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832903.299877:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832903.299879:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832903.302969:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832903.303080:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975429376 00000100:00100000:1.0:1788832903.303090:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975429376 00000100:00100000:1.0:1788832903.303148:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 128 00000100:00100000:1.0:1788832903.303159:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:10593:x1875726975429376:12345-192.168.206.41@tcp:58:lfs.0 00000040:00080000:1.0:1788832903.303389:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788832903.303483:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:10593:x1875726975429376:12345-192.168.206.41@tcp:58:lfs.0 Request processed in 326us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832903.303491:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 128 00000100:00100000:1.0:1788832903.348251:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832903.348467:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975429504 00000100:00100000:2.0:1788832903.348476:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975429504 00000100:00100000:2.0:1788832903.348545:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 129 00000100:00100000:2.0:1788832903.348554:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:10596:x1875726975429504:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832903.348575:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832903.348607:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a53ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555be expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.348683:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a53f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.348696:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a53f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.348708:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a53f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.348723:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a53fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.348729:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a53fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.348736:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a53fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.349128:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.349140:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5557f expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.349148:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5401 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.349178:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5557f expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832903.349215:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5557f expref: 21 pid: 5854 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832903.349229:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994312832:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832903.350096:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832903.353966:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994312832:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832903.353999:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832903.358449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832903.359141:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975429760 00000100:00100000:2.0:1788832903.359151:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975429760 00000100:00100000:2.0:1788832903.359206:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 33 00000100:00100000:2.0:1788832903.359215:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+22:5594:x1875726975429760:12345-192.168.206.41@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788832903.359576:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+23:5594:x1875726975429760:12345-192.168.206.41@tcp:35:ldlm_bl.0 Request processed in 361us (1133us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788832903.359583:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 33 00000100:00100000:3.0:1788832903.362939:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832903.363121:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975429888 00000100:00100000:0.0:1788832903.363130:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975429888 00010000:00010000:0.0:1788832903.363165:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5557f expref: 23 pid: 5854 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832903.363223:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 60 00000100:00100000:0.0:1788832903.363232:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06e59450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+23:2357:x1875726975429888:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832903.363246:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832903.363252:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5557f expref: 23 pid: 5854 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.363265:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5557f expref: 23 pid: 5854 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.363284:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a530c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5557f expref: 23 pid: 5854 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.363300:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:0.0:1788832903.363304:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.363324:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.363336:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5401 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832903.363366:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832903.363417:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06e59450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+22:2357:x1875726975429888:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 186us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832903.363424:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 60 00010000:00010000:1.0:1788832903.364701:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.364714:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832903.364779:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788832903.364783:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788832903.364800:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.364812:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.364831:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a53f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.364837:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a53f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.364844:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a53f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.364873:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832903.364877:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a53f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.364975:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a53f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.364988:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:1.0:1788832903.364991:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832903.364994:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a53f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.365000:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a53f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.365014:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a53fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.365019:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a53fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.365025:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a53fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.365030:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832903.365033:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a53fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.365038:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a53fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.365055:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff984d0c2cf400) 00010000:00010000:1.0:1788832903.365057:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832903.365060:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a53fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.365066:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a53fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.365103:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a53ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555be expref: 22 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.365117:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555be expref: 21 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832903.365125:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832903.365127:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832903.365129:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703e00, rc 0) 00000100:00100000:1.0:1788832903.365861:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:10596:x1875726975429504:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 17295us (17605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832903.365872:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 129 00010000:00010000:1.0:1788832903.780415:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832903.832321:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994312960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832903.832398:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832903.833263:0:11720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994312960 00000100:00100000:1.0:1788832903.833273:0:11720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994312960 00000100:00100000:1.0:1788832903.833321:0:11720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788832903.833343:0:11720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875726994312960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832903.833376:0:11720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832903.837724:0:11720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875726994312960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4387us (5317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832903.837775:0:11720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788832903.841168:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994312960:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788832904.326376:0:12120:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832904.326385:0:12120:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832904.326433:0:12120:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788832904.326440:0:12120:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788832904.342900:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832904.342918:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832904.342954:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788832904.342960:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832904.343066:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b35f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875726994313088:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832904.343167:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832904.356960:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b35f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875726994313088:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788832904.357291:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832904.357659:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975430016 00000100:00100000:0.0:1788832904.357666:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975430016 00000100:00100000:0.0:1788832904.357728:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 130 00000100:00100000:0.0:1788832904.357738:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:10607:x1875726975430016:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788832904.357791:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788832904.357892:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:10607:x1875726975430016:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 Request processed in 155us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832904.357899:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 130 00000100:00080000:2.0:1788832904.358143:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832904.361125:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832904.361384:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975430272 00000100:00100000:1.0:1788832904.361393:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975430272 00000100:00100000:1.0:1788832904.361455:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 131 00000100:00100000:1.0:1788832904.361465:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:10607:x1875726975430272:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832904.361481:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832904.361500:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5408 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555c5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832904.361610:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a540f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832904.361623:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a540f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832904.361636:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a540f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832904.361646:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788832904.361789:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5408 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555c5 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832904.361805:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a540f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555c5 expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832904.361813:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832904.361816:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832904.361819:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05400, rc 0) 00000100:00100000:1.0:1788832904.362062:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+23:10607:x1875726975430272:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 597us (943us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788832904.362069:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 131 00000100:00100000:0.0:1788832904.370730:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832904.370835:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975430400 00000100:00100000:1.0:1788832904.370844:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975430400 00000100:00100000:1.0:1788832904.370963:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:1.0:1788832904.370973:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+23:2359:x1875726975430400:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832904.370986:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832904.371018:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a540f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555c5 expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832904.371033:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832904.371038:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832904.371088:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+22:2359:x1875726975430400:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 117us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832904.371095:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:3.0:1788832904.376892:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832904.377032:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975430656 00000100:00100000:0.0:1788832904.377042:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975430656 00000100:00100000:0.0:1788832904.377100:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 132 00000100:00100000:0.0:1788832904.377110:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+22:10607:x1875726975430656:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788832904.377179:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a541d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832904.377194:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a541d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832904.377204:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a541d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832904.377398:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a541d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832904.377407:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a541d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832904.377414:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a541d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832904.377420:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036baa00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832904.377424:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a541d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832904.377431:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a541d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832904.377443:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:0.0:1788832904.377445:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788832904.377450:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a541d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832904.377456:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a541d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832904.377593:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+23:10607:x1875726975430656:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 473us (697us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788832904.377601:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 132 00000040:00080000:0.0:1788832904.378071:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832904.378075:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832904.378553:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788832904.378569:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788832904.390347:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832904.390381:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975430912 00000100:00100000:3.0:1788832904.390389:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975430912 00000100:00100000:3.0:1788832904.390441:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 34 00000100:00100000:3.0:1788832904.390452:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+23:10607:x1875726975430912:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788832904.390667:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+24:10607:x1875726975430912:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 216us (327us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788832904.390675:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 34 00010000:00010000:2.0:1788832904.789941:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832905.814929:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788832905.914678:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1788832905.914703:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000040:00080000:3.0:1788832906.015466:0:12173:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788832906.015474:0:12173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788832906.015513:0:12173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788832906.015518:0:12173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832906.260044:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832906.260109:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975431168 00000100:00100000:1.0:1788832906.260118:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975431168 00000100:00100000:1.0:1788832906.260249:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 133 00000100:00100000:1.0:1788832906.260260:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+24:10629:x1875726975431168:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832906.260281:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832906.260348:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5424 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555cc expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.260435:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a542b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.260464:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a542b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.260475:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a542b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832906.260487:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788832906.260632:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5424 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555cc expref: 27 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.260649:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a542b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555cc expref: 26 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.260658:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832906.260661:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788832906.260664:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04c00, rc 0) 00000100:00100000:1.0:1788832906.260734:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:10629:x1875726975431168:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 476us (698us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788832906.260783:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 133 00000100:00080000:3.0:1788832906.265509:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832906.272440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832906.272770:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975431296 00000100:00100000:1.0:1788832906.272779:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975431296 00000100:00100000:1.0:1788832906.272832:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 134 00000100:00100000:1.0:1788832906.272850:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:10629:x1875726975431296:12345-192.168.206.41@tcp:54:lfs.0 00010000:00010000:1.0:1788832906.272913:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5439 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.272930:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.272957:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.272981:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.272988:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5439 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.272994:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.272999:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832906.273003:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.273010:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5439 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.273021:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832906.273024:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832906.273028:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5439 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832906.273034:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a5439 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832906.273097:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:10629:x1875726975431296:12345-192.168.206.41@tcp:54:lfs.0 Request processed in 257us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832906.273104:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 134 00000100:00100000:2.0:1788832906.359658:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832906.359960:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975431424 00000100:00100000:0.0:1788832906.359973:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975431424 00000100:00100000:0.0:1788832906.360152:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 45 00000100:00100000:0.0:1788832906.360165:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2357:x1875726975431424:12345-192.168.206.41@tcp:101:cat.0 00010000:00010000:0.0:1788832906.360186:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832906.360217:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c46be351/0xd270a10c1c6a5440 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555d3 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788832906.360252:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f6c86, atime: 0x6a9f6c85, ctime: 0x6a9f6c86, blocks: 0xb 00010000:00010000:0.0:1788832906.360276:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1788832906.360282:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832906.360294:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c46be351/0xd270a10c1c6a5440 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555d3 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832906.360333:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c46be351/0xd270a10c1c6a5440 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555d3 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832906.360593:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bb400, rc 0) 00000100:00100000:0.0:1788832906.360678:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975431424:12345-192.168.206.41@tcp:101:cat.0 Request processed in 517us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832906.360687:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 45 00000100:00080000:2.0:1788832906.365118:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832906.370597:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832906.370729:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975431552 00000100:00100000:1.0:1788832906.370771:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975431552 00002000:00100000:1.0:1788832906.370817:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff984d3b35e300 x1875726975431552/t0(0) o3->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:92/0 lens 488/0 e 0 to 0 dl 1788832917 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832906.370827:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3b35e300 with x1875726975431552 ext(0->4095) 00002000:00010000:1.0:1788832906.370832:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984d3b35e300 00000100:00100000:1.0:1788832906.370863:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 3 00000100:00100000:1.0:1788832906.370873:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975431552:12345-192.168.206.41@tcp:3:cat.0 00000100:00100000:1.0:1788832906.371291:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975431552:12345-192.168.206.41@tcp:3:cat.0 Request processed in 418us (702us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788832906.371366:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 3 00002000:00100000:1.0:1788832906.371375:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff984d3b35e300 x1875726975431552/t0(0) o3->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:92/0 lens 488/4536 e 0 to 0 dl 1788832917 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832906.371383:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3b35e300 with x1875726975431552 ext(0->4095) 00002000:00010000:1.0:1788832906.371387:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984d3b35e300 00010000:00010000:1.0:1788832906.838028:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788832907.414130:0:7729:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411104384110ns, next at 412104381986ns, rc = 0 00000100:00100000:1.0:1788832907.414190:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994313216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832907.414252:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832907.414479:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994313216 00000100:00100000:0.0:1788832907.414509:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994313216 00000100:00100000:0.0:1788832907.414583:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788832907.414594:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875726994313216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832907.414624:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832907.414671:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875726994313216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832907.414678:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788832907.414802:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832907.414845:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994313216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832907.415163:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994313472:0@lo:400:kworker.0 00000100:00100000:1.0:1788832907.415197:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832907.415228:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788832907.415234:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994313344:0@lo:400:kworker.0 00000100:00100000:1.0:1788832907.415262:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832907.415312:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994313856:0@lo:400:kworker.0 00000100:00100000:1.0:1788832907.415338:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832907.415363:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994313728:0@lo:400:kworker.0 00000100:00100000:1.0:1788832907.415388:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832907.415407:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832907.415413:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994313600:0@lo:400:kworker.0 00000100:00100000:1.0:1788832907.415435:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832907.415461:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994313344 00000100:00100000:1.0:1788832907.415466:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994313344 00000100:00100000:1.0:1788832907.415495:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788832907.415516:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994313344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832907.415552:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994313344:12345-0@lo:400:kworker.0 Request processed in 51us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832907.415559:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788832907.415598:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994313472 00000100:00100000:1.0:1788832907.415602:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994313472 00000100:00100000:1.0:1788832907.415626:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994313856 00000100:00100000:1.0:1788832907.415629:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994313856 00000100:00100000:1.0:1788832907.415646:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994313600 00000100:00100000:1.0:1788832907.415649:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994313600 00000100:00100000:1.0:1788832907.415664:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788832907.415670:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994313472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832907.415702:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994313472:12345-0@lo:400:kworker.0 Request processed in 33us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832907.415709:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788832907.415720:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788832907.415726:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994313856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832907.415792:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994313856:12345-0@lo:400:kworker.0 Request processed in 66us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832907.415798:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788832907.415810:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788832907.416004:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994313600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832907.416040:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994313600:12345-0@lo:400:kworker.0 Request processed in 224us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832907.416045:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788832907.416063:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994313728 00000100:00100000:1.0:1788832907.416066:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994313728 00000100:00100000:1.0:1788832907.416091:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788832907.416097:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994313728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832907.416125:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994313728:12345-0@lo:400:kworker.0 Request processed in 28us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832907.416130:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788832907.416160:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994313344:0@lo:400:kworker.0 00000100:00100000:1.0:1788832907.416171:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994313856:0@lo:400:kworker.0 00000100:00100000:1.0:1788832907.416180:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994313472:0@lo:400:kworker.0 00000100:00080000:1.0:1788832907.416204:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832907.416208:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832907.416219:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994313600:0@lo:400:kworker.0 00000100:00100000:1.0:1788832907.416226:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788832907.416230:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1788832907.416243:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984d3b717100, transno 4294967304 00000100:00100000:1.0:1788832907.416259:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994313728:0@lo:400:kworker.0 00000100:00100000:3.0:1788832907.610924:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832907.610962:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832907.611005:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832907.611024:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832907.611056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832907.611086:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975432064 00000100:00100000:3.0:1788832907.611094:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975432064 00000100:00100000:3.0:1788832907.611138:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975431936 00000100:00100000:3.0:1788832907.611141:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975431936 00000100:00100000:3.0:1788832907.611171:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 64 00000100:00100000:3.0:1788832907.611180:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2359:x1875726975432064:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832907.611254:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2359:x1875726975432064:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 74us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832907.611262:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 64 00000100:00100000:3.0:1788832907.611277:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 65 00000100:00100000:3.0:1788832907.611283:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2359:x1875726975431936:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832907.611320:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2359:x1875726975431936:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 37us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832907.611326:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 65 00000100:00100000:3.0:1788832907.611344:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975431680 00000100:00100000:3.0:1788832907.611347:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975431680 00000100:00100000:3.0:1788832907.611372:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 291 00000100:00100000:3.0:1788832907.611378:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975431680:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832907.611401:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975431680:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 24us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832907.611408:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 291 00000100:00100000:3.0:1788832907.611431:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975431808 00000100:00100000:3.0:1788832907.611435:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975431808 00000100:00100000:3.0:1788832907.611459:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975432192 00000100:00100000:3.0:1788832907.611462:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975432192 00000100:00100000:3.0:1788832907.611481:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 142 00000100:00100000:3.0:1788832907.611486:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:2359:x1875726975431808:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832907.611513:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:2359:x1875726975431808:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 26us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832907.611519:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 142 00000100:00100000:3.0:1788832907.611529:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 143 00000100:00100000:3.0:1788832907.611543:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2359:x1875726975432192:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832907.611581:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2359:x1875726975432192:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 25us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832907.611587:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 143 00000100:00080000:3.0:1788832907.611608:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788832907.611612:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788832907.863045:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788832908.506403:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:1.0:1788832908.508425:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994313984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788832908.508493:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1788832908.510978:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:3.0:1788832908.511003:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1788832908.511019:0:5875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984d11418c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788832908.511024:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d06249100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984d114186c0 00000020:00080000:3.0:1788832908.511027:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d06249600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984d3b2e5800 00000020:00080000:3.0:1788832908.511053:0:5875:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788832908.511070:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788832908.511265:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1788832908.511904:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994313984 00000100:00100000:2.0:1788832908.511913:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994313984 00000100:00100000:2.0:1788832908.512007:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788832908.512017:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1875726994313984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788832908.512199:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788832908.512203:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788832902 -> 1788832902 00002000:00010000:2.0:1788832908.512206:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1788832901 -> 1788832901 00002000:00010000:2.0:1788832908.512209:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788832902 -> 1788832902 00002000:00010000:2.0:1788832908.512211:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788832908.512274:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3315:x1875726994313984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 259us (3782us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788832908.512281:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:2.0:1788832908.512422:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984d3b37e680/2, rc 0, transno 4294967312 00000100:00100000:2.0:1788832908.512429:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994313984:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1788832908.525228:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1788832908.525254:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:2.0:1788832908.887615:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832908.951152:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832908.951183:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c05479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994314112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832908.951283:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832908.960955:0:11720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994314112 00000100:00100000:1.0:1788832908.960974:0:11720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994314112 00000100:00100000:1.0:1788832908.961046:0:11720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788832908.961059:0:11720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994314112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832908.961107:0:11720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832908.961212:0:11720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994314112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (9928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832908.961221:0:11720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788832908.961305:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c05479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994314112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788832909.910194:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788832910.552697:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832910.552710:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832910.553039:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1788832910.553047:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788832910.936958:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832911.333733:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832911.334044:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975432320 00000100:00100000:3.0:1788832911.334058:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975432320 00000100:00100000:3.0:1788832911.334156:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 135 00000100:00100000:3.0:1788832911.334168:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:10272:x1875726975432320:12345-192.168.206.41@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788832911.334294:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:10272:x1875726975432320:12345-192.168.206.41@tcp:60:lhsmtool_posix.0 Request processed in 129us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832911.334302:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 135 00000100:00080000:1.0:1788832911.334784:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832911.356695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832911.357832:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975432576 00000100:00100000:3.0:1788832911.357847:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975432576 00000100:00100000:3.0:1788832911.357937:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 35 00000100:00100000:3.0:1788832911.357949:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:10272:x1875726975432576:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788832911.358413:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:10272:x1875726975432576:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 464us (1731us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788832911.358422:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 35 00000100:00100000:2.0:1788832911.752861:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832911.753125:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975432704 00000100:00100000:1.0:1788832911.753135:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975432704 00000100:00100000:1.0:1788832911.753205:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 136 00000100:00100000:1.0:1788832911.753216:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:11082:x1875726975432704:12345-192.168.206.41@tcp:101:lsof.0 00010000:00010000:1.0:1788832911.753234:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832911.753253:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5447 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555da expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832911.753309:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a544e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832911.753333:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a544e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832911.753358:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a544e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832911.753391:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788832911.753395:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788832911.753430:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a544e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832911.753452:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5447 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555da expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832911.753467:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a544e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555da expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832911.753485:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60a00) 00010000:00010000:1.0:1788832911.753489:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832911.753492:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05400, rc 0) 00000100:00100000:1.0:1788832911.753556:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:11082:x1875726975432704:12345-192.168.206.41@tcp:101:lsof.0 Request processed in 333us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832911.753563:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 136 00000100:00080000:3.0:1788832911.754241:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788832911.958354:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832912.534131:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994314240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832912.534194:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832912.534319:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994314240 00000100:00100000:2.0:1788832912.534327:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994314240 00000100:00100000:2.0:1788832912.534378:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788832912.534387:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875726994314240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832912.534418:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788832912.534486:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832912.534619:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994314496:0@lo:400:kworker.0 00000100:00100000:0.0:1788832912.534651:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832912.534676:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788832912.534682:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994314368:0@lo:400:kworker.0 00000100:00100000:0.0:1788832912.534709:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832912.534766:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994314496 00000100:00100000:0.0:1788832912.534770:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994314496 00000100:00100000:0.0:1788832912.534801:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788832912.534808:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994314496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832912.534843:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994314496:12345-0@lo:400:kworker.0 Request processed in 36us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832912.534850:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788832912.534870:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994314368 00000100:00100000:0.0:1788832912.534873:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994314368 00000100:00100000:0.0:1788832912.534896:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788832912.534902:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994314368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832912.534930:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994314368:12345-0@lo:400:kworker.0 Request processed in 28us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832912.534945:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788832912.535775:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994314368:0@lo:400:kworker.0 00000100:00100000:0.0:1788832912.535789:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994314496:0@lo:400:kworker.0 00000100:00100000:0.0:1788832912.535824:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994314624:0@lo:400:kworker.0 00000100:00100000:0.0:1788832912.535852:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832912.535885:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994314624 00000100:00100000:0.0:1788832912.535889:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994314624 00000100:00100000:0.0:1788832912.535921:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788832912.535927:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994314624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832912.535957:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994314624:12345-0@lo:400:kworker.0 Request processed in 30us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832912.535962:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1788832912.535974:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832912.535990:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994314624:0@lo:400:kworker.0 00000100:00100000:1.0:1788832912.536117:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000100:00100000:2.0:1788832912.536118:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875726994314240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1732us (1924us total) trans 0 rc 0/0 00000004:00080000:1.0:1788832912.536123:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984d3b717b80, transno 4294967309 00000100:00100000:2.0:1788832912.536125:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1788832912.536190:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:1.0:1788832912.536210:0:3317:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff984d3b37e680 x1875726994313984/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788832924 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832912.536243:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994314240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832912.536278:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994314752:0@lo:400:kworker.0 00000100:00100000:1.0:1788832912.536305:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832912.536312:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994314880:0@lo:400:kworker.0 00000100:00100000:1.0:1788832912.536338:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994314752 00000100:00100000:3.0:1788832912.536339:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832912.536342:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994314752 00000100:00100000:1.0:1788832912.536373:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788832912.536379:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832912.536380:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c0547aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994314752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832912.536420:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c0547aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994314752:12345-0@lo:400:kworker.0 Request processed in 41us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832912.536425:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994314752:0@lo:400:kworker.0 00000100:00100000:1.0:1788832912.536502:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788832912.536773:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994314880 00000100:00100000:2.0:1788832912.536779:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994314880 00000100:00100000:2.0:1788832912.536844:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788832912.536854:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994314880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832912.536897:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994314880:12345-0@lo:400:kworker.0 Request processed in 46us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832912.536909:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788832912.537091:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994314880:0@lo:400:kworker.0 00000100:00080000:3.0:1788832912.537108:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832912.734728:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832912.734840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832912.734877:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832912.734899:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832912.734923:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832912.734949:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975433344 00000100:00100000:0.0:1788832912.734957:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975433344 00000100:00100000:0.0:1788832912.735000:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975432960 00000100:00100000:0.0:1788832912.735003:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975432960 00000100:00100000:0.0:1788832912.735024:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 147 00000100:00100000:0.0:1788832912.735034:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:2359:x1875726975433344:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832912.735129:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:2359:x1875726975433344:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 96us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832912.735137:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 147 00000100:00100000:0.0:1788832912.735154:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 148 00000100:00100000:0.0:1788832912.735160:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:2359:x1875726975432960:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832912.735190:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:2359:x1875726975432960:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832912.735196:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 148 00000100:00100000:3.0:1788832912.735420:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975432832 00000100:00100000:3.0:1788832912.735425:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975432832 00000100:00100000:3.0:1788832912.735472:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 293 00000100:00100000:3.0:1788832912.735480:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975432832:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832912.735597:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975433088 00000100:00100000:2.0:1788832912.735602:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975433088 00000100:00100000:2.0:1788832912.735638:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975433216 00000100:00100000:2.0:1788832912.735641:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975433216 00000100:00100000:2.0:1788832912.735662:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 67 00000100:00100000:2.0:1788832912.735669:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2359:x1875726975433088:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832912.736156:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 68 00000100:00100000:0.0:1788832912.736167:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975433216:12345-192.168.206.41@tcp:400:kworker.0 00000100:00080000:1.0:1788832912.736481:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832912.736485:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832912.739613:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975432832:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 4122us (4883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832912.739629:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 293 00000100:00100000:2.0:1788832912.740986:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2359:x1875726975433088:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 5309us (6138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832912.740999:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 67 00000100:00100000:0.0:1788832912.750091:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975433216:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 13914us (15155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832912.750106:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 68 00010000:00010000:1.0:1788832912.982384:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788832913.597943:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1788832913.598890:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1788832913.599067:0:5875:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788832913.599126:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788832913.599137:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1788832914.006248:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832914.070115:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c05478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994315008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832914.070185:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832914.070308:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994315008 00000100:00100000:1.0:1788832914.070316:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994315008 00000100:00100000:1.0:1788832914.070371:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788832914.070381:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994315008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832914.070411:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832914.070511:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994315008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832914.070518:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788832914.070585:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832914.070624:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c05478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994315008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788832915.030139:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788832915.282106:0:12375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:01:54 (1788832914) 00010000:00010000:1.0:1788832916.055034:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832917.080916:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832917.217132:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832917.217571:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975433600 00000100:00100000:0.0:1788832917.217582:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975433600 00000100:00100000:0.0:1788832917.217669:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 137 00000100:00100000:0.0:1788832917.217681:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:11347:x1875726975433600:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788832917.217712:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832917.217770:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a5455 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555e1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.217842:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a545c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.217855:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a545c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.217865:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a545c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.217922:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5463 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.217929:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5463 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.217935:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5463 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218145:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a546a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218154:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a546a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218162:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a546a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832917.218170:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788832917.218308:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a545c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218325:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a545c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218332:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a545c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218339:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832917.218343:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a545c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218349:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a545c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218360:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff984d02d42c00) 00010000:00010000:0.0:1788832917.218363:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832917.218367:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a545c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218374:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a545c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218387:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5463 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218392:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5463 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218398:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5463 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218404:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832917.218412:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5463 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218418:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5463 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218427:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff984d03c60b00) 00010000:00010000:0.0:1788832917.218429:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832917.218432:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5463 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218437:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5463 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218891:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a5455 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555e1 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218907:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a546a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555e1 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832917.218914:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d02d42000) 00010000:00010000:0.0:1788832917.218917:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832917.218919:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bb600, rc 0) 00000100:00100000:0.0:1788832917.218984:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:11347:x1875726975433600:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 1305us (1861us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788832917.218991:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 137 00000100:00080000:1.0:1788832917.219276:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832917.223483:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832917.223539:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832917.223618:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975433856 00000100:00100000:3.0:1788832917.223628:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975433856 00000100:00100000:3.0:1788832917.223695:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00100000:3.0:1788832917.223706:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:2358:x1875726975433856:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832917.223734:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832917.223792:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a546a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555e1 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832917.223851:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975433728 00000100:00100000:1.0:1788832917.223856:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975433728 00000100:00100000:1.0:1788832917.223898:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 138 00000100:00100000:1.0:1788832917.223907:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:11347:x1875726975433728:12345-192.168.206.41@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788832917.224011:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+16:11347:x1875726975433728:12345-192.168.206.41@tcp:59:lhsmtool_posix.0 Request processed in 105us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832917.224018:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 138 00010000:00010000:3.0:1788832917.225199:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d02d42000) 00010000:00010000:3.0:1788832917.225205:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832917.225310:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:2358:x1875726975433856:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 1603us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832917.225318:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00100000:3.0:1788832917.657930:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994315264:0@lo:400:kworker.0 00000100:00100000:3.0:1788832917.657994:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832917.658053:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994315776:0@lo:400:kworker.0 00000100:00100000:3.0:1788832917.658090:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832917.658119:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788832917.658126:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994315136:0@lo:400:kworker.0 00000100:00100000:3.0:1788832917.658166:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832917.658189:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994315648:0@lo:400:kworker.0 00000100:00100000:3.0:1788832917.658213:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832917.658244:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994315392:0@lo:400:kworker.0 00000100:00100000:3.0:1788832917.658268:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832917.658284:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832917.658290:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994315520:0@lo:400:kworker.0 00000100:00100000:3.0:1788832917.658311:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832917.658339:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994315136 00000100:00100000:3.0:1788832917.658346:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994315136 00000100:00100000:3.0:1788832917.658395:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788832917.658403:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994315136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832917.658450:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994315136:12345-0@lo:400:kworker.0 Request processed in 47us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832917.658457:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788832917.658498:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994315136:0@lo:400:kworker.0 00000100:00100000:3.0:1788832917.658550:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994315264 00000100:00100000:3.0:1788832917.658554:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994315264 00000100:00100000:3.0:1788832917.658581:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994315648 00000100:00100000:3.0:1788832917.658584:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994315648 00000100:00100000:3.0:1788832917.658603:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994315392 00000100:00100000:3.0:1788832917.658606:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994315392 00000100:00100000:3.0:1788832917.658620:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788832917.658626:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994315264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832917.658673:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994315264:12345-0@lo:400:kworker.0 Request processed in 46us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832917.658679:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788832917.658693:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788832917.658699:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994315648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832917.658724:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994315648:12345-0@lo:400:kworker.0 Request processed in 27us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832917.658729:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788832917.658739:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788832917.658768:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994315392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832917.658799:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994315392:12345-0@lo:400:kworker.0 Request processed in 55us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832917.658812:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788832917.658844:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994315392:0@lo:400:kworker.0 00000100:00100000:3.0:1788832917.658866:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994315648:0@lo:400:kworker.0 00000100:00100000:3.0:1788832917.658874:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994315264:0@lo:400:kworker.0 00000100:00100000:1.0:1788832917.658983:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994315776 00000100:00100000:1.0:1788832917.658988:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994315776 00000100:00100000:1.0:1788832917.659013:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994315520 00000100:00100000:1.0:1788832917.659016:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994315520 00000100:00100000:1.0:1788832917.659032:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788832917.659037:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994315776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832917.659073:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994315776:12345-0@lo:400:kworker.0 Request processed in 35us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832917.659078:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788832917.659088:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788832917.659093:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994315520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832917.659116:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994315520:12345-0@lo:400:kworker.0 Request processed in 23us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832917.659120:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1788832917.659140:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832917.659144:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832917.659146:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832917.659165:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994315520:0@lo:400:kworker.0 00000100:00100000:1.0:1788832917.659184:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788832917.659188:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984d3b37e680, transno 4294967312 00000100:00100000:1.0:1788832917.659205:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994315776:0@lo:400:kworker.0 00000100:00100000:2.0:1788832917.660014:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994315904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832917.660057:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832917.660125:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994315904 00000100:00100000:3.0:1788832917.660131:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994315904 00000100:00100000:3.0:1788832917.660173:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788832917.660181:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3adef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994315904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832917.660205:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788832917.662011:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3adef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994315904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1824us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832917.662021:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788832917.662819:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994315904:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788832917.725579:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788832917.725590:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788832917.727578:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788832917.727592:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788832917.861686:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832917.861796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832917.861826:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832917.861875:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832917.861927:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975434368 00000100:00100000:0.0:1788832917.861937:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975434368 00000100:00100000:0.0:1788832917.862009:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 152 00000100:00100000:0.0:1788832917.862019:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:2358:x1875726975434368:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832917.862111:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:2358:x1875726975434368:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 93us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832917.862119:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 152 00000100:00080000:0.0:1788832917.863690:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832917.866234:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975433984 00000100:00100000:3.0:1788832917.866247:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975433984 00000100:00100000:3.0:1788832917.866299:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 295 00000100:00100000:3.0:1788832917.866309:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2358:x1875726975433984:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832917.866383:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2358:x1875726975433984:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 75us (4556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832917.866391:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 295 00000100:00100000:1.0:1788832917.876360:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975434112 00000100:00100000:1.0:1788832917.876381:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975434112 00000100:00100000:1.0:1788832917.876533:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975434240 00000100:00100000:1.0:1788832917.876538:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975434240 00000100:00100000:3.0:1788832917.879860:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 71 00000100:00100000:3.0:1788832917.879886:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975434112:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832917.879971:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975434112:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 90us (18292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832917.879979:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 71 00000100:00080000:0.0:1788832917.885154:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832917.885163:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832917.885559:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 72 00000100:00100000:1.0:1788832917.885573:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975434240:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832917.885657:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975434240:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 87us (23780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832917.885664:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 72 00010000:00010000:2.0:1788832918.102026:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788832918.751997:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:2.0:1788832918.957123:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832918.957267:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975434496 00000100:00100000:3.0:1788832918.957277:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975434496 00000100:00100000:3.0:1788832918.957338:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 139 00000100:00100000:3.0:1788832918.957348:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:11389:x1875726975434496:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:3.0:1788832918.957366:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832918.957385:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5478 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555e8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957458:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a547f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957473:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a547f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957485:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a547f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957501:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5486 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957522:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957540:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957807:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a547f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957814:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a547f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957821:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a547f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957828:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832918.957832:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a547f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957840:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a547f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957854:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60a00) 00010000:00010000:3.0:1788832918.957857:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832918.957862:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a547f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957868:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a547f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957880:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957886:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5486 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957892:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5486 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957903:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832918.957908:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5486 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957914:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5486 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957925:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff984d07e81000) 00010000:00010000:3.0:1788832918.957927:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832918.957931:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5486 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957937:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5486 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957984:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5478 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555e8 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.957999:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60a00) 00010000:00010000:3.0:1788832918.958001:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832918.958005:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5478 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555e8 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832918.958021:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3e00, rc 0) 00000100:00100000:3.0:1788832918.958077:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:11389:x1875726975434496:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 730us (961us total) trans 0 rc 301/301 00000100:00100000:3.0:1788832918.958085:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 139 00000100:00100000:3.0:1788832918.963693:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832918.965007:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975434752 00000100:00100000:0.0:1788832918.965017:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975434752 00000100:00100000:0.0:1788832918.965082:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 140 00000100:00100000:0.0:1788832918.965093:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:11389:x1875726975434752:12345-192.168.206.41@tcp:36:lfs.0 00010000:00010000:0.0:1788832918.965143:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832918.965180:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207fc00/0xd270a10c1c6a4df6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55421 expref: 13 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832918.965202:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60a00) 00010000:00010000:0.0:1788832918.965207:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832918.965411:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832918.965426:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a544e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555da expref: 5 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832918.965434:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832918.965610:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a544e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555da expref: 5 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832918.965634:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a544e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555da expref: 5 pid: 5855 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832918.965647:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b717100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994316032:192.168.206.41@tcp:104: 00000100:00100000:0.0:1788832918.965740:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac83480 going to sleep for 11 seconds 00000100:00100000:1.0:1788832918.970287:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b717100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994316032:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832918.970313:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832918.971113:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832918.971994:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975434880 00000100:00100000:0.0:1788832918.972004:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975434880 00010000:00010000:0.0:1788832918.972039:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a544e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555da expref: 6 pid: 5855 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832918.972079:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 61 00000100:00100000:0.0:1788832918.972088:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:2357:x1875726975434880:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832918.972100:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832918.972106:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a544e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555da expref: 6 pid: 5855 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832918.972120:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a544e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555da expref: 6 pid: 5855 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832918.972141:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a544e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555da expref: 6 pid: 5855 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832918.972155:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60a00) 00010000:00010000:0.0:1788832918.972160:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832918.972179:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832918.972186:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832918.972218:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832918.972271:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2357:x1875726975434880:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 182us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832918.972278:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 61 00010000:00010000:2.0:1788832918.973005:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.973018:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.973046:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5494 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.973058:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.973068:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832918.975387:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788832918.975403:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.975420:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.975428:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.975434:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bbe00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832918.975439:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.975447:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.975461:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60a00) 00010000:00010000:2.0:1788832918.975464:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832918.975469:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.975474:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a548d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788832918.975493:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042792906 reply state 00000000f4d62bb1 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832918.975500:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832918.975617:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:11389:x1875726975434752:12345-192.168.206.41@tcp:36:lfs.0 Request processed in 10523us (11928us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788832918.975626:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 140 00010000:00010000:2.0:1788832918.984553:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.984578:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5494 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.984587:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5494 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.984594:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832918.984599:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5494 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.984607:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5494 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.984624:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff984d0c2cf300) 00010000:00010000:2.0:1788832918.984627:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832918.984632:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5494 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832918.984639:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5494 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832919.079435:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832919.080076:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975435008 00000100:00100000:0.0:1788832919.080086:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975435008 00000100:00080000:1.0:1788832919.080204:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832919.080210:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 141 00000100:00100000:0.0:1788832919.080224:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:11397:x1875726975435008:12345-192.168.206.41@tcp:101:lctl.0 00010000:00010000:0.0:1788832919.080247:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832919.080270:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a549b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555ef expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.080331:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a54a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.080345:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a54a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.080356:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a54a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832919.080389:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788832919.080393:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788832919.080428:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a54a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.080489:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a549b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555ef expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.080519:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a54a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555ef expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.080529:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:0.0:1788832919.080532:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832919.080535:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bb200, rc 0) 00000100:00100000:0.0:1788832919.080602:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:11397:x1875726975435008:12345-192.168.206.41@tcp:101:lctl.0 Request processed in 381us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832919.080609:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 141 00010000:00010000:1.0:1788832919.127317:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832919.138294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832919.138541:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975435136 00000100:00100000:1.0:1788832919.138551:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975435136 00000100:00100000:1.0:1788832919.138607:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 142 00000100:00100000:1.0:1788832919.138618:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:11403:x1875726975435136:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:1.0:1788832919.138636:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832919.138655:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a54a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555f6 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.138712:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a54b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.138726:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a54b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.140910:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a54b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.140938:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a54b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.140950:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a54b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.140957:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a54b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141070:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a54be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141079:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a54be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141087:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a54be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832919.141116:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788832919.141120:0:7174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788832919.141138:0:7174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a54be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141151:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a54b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141158:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a54b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141180:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a54b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141185:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832919.141190:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a54b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141198:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a54b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141209:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:1.0:1788832919.141212:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832919.141217:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a54b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141224:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a54b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141238:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a54b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141245:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a54b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141251:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a54b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141256:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832919.141258:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a54b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141272:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a54b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141281:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff984d02d42b00) 00010000:00010000:1.0:1788832919.141283:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832919.141286:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a54b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141292:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a54b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141620:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a54a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555f6 expref: 16 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141635:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a54be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555f6 expref: 15 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.141643:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:1.0:1788832919.141645:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788832919.141647:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05800, rc 0) 00000100:00100000:1.0:1788832919.141814:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:11403:x1875726975435136:12345-192.168.206.41@tcp:101:bash.0 Request processed in 3197us (3529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832919.141823:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 142 00000100:00100000:2.0:1788832919.152037:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832919.152194:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975435392 00000100:00100000:3.0:1788832919.152204:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975435392 00000100:00100000:3.0:1788832919.152260:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 143 00000100:00100000:3.0:1788832919.152270:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+15:11403:x1875726975435392:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:3.0:1788832919.152289:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832919.152310:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a54c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b555fd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.152457:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a54cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.152472:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a54cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.152483:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a54cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.152496:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a54d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.152503:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a54d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.152520:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a54d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788832919.153292:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788832919.153633:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a54da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.153655:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a54da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.153663:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a54da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.153699:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a54cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.153705:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a54cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.153712:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a54cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.153718:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832919.153722:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a54cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.153728:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a54cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.153740:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:3.0:1788832919.153767:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832919.153837:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a54cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.153846:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a54cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788832919.153859:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2e299a2 reply state 0000000049431261 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a54d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832919.153873:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788832919.153904:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a54c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555fd expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.153919:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a54da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555fd expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.153927:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d07e81f00) 00010000:00010000:3.0:1788832919.153929:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832919.153931:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3800, rc 0) 00000100:00100000:3.0:1788832919.154039:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:11403:x1875726975435392:12345-192.168.206.41@tcp:101:bash.0 Request processed in 1770us (2009us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788832919.154048:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 143 00000100:00100000:2.0:1788832919.164104:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832919.164685:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975435520 00000100:00100000:3.0:1788832919.164695:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975435520 00000100:00100000:3.0:1788832919.164791:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 47 00000100:00100000:3.0:1788832919.164802:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2358:x1875726975435520:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:3.0:1788832919.164817:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832919.164838:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000229b63d6/0xd270a10c1c6a54e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55604 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832919.164863:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788832919.164880:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788832919.164884:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832919.164893:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000229b63d6/0xd270a10c1c6a54e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55604 expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.164932:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000229b63d6/0xd270a10c1c6a54e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55604 expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.164946:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2600, rc 0) 00000100:00100000:3.0:1788832919.165003:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975435520:12345-192.168.206.41@tcp:101:bash.0 Request processed in 203us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832919.165010:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 47 00010000:00010000:1.0:1788832919.165154:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a54d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.165164:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a54d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.165183:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a54d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.165188:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832919.165192:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a54d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.165200:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a54d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.165213:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d07e81000) 00010000:00010000:1.0:1788832919.165216:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832919.165221:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a54d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.165233:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a54d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788832919.166262:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832919.169102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832919.169639:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975435648 00000100:00100000:1.0:1788832919.169649:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975435648 00000100:00100000:1.0:1788832919.169780:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 48 00000100:00100000:1.0:1788832919.169792:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:11403:x1875726975435648:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:1.0:1788832919.169809:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832919.169826:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5560b expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.169856:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000229b63d6/0xd270a10c1c6a54e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55604 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.169883:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832919.169887:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832919.169892:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.169925:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000229b63d6/0xd270a10c1c6a54e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55604 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.169938:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000229b63d6/0xd270a10c1c6a54e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55604 expref: 7 pid: 6699 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832919.169951:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c05479500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875726994316160:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832919.170038:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d05305600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832919.177487:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c05479500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875726994316160:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832919.177537:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.177558:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05400, rc 0) 00000100:00100000:1.0:1788832919.177619:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:11403:x1875726975435648:12345-192.168.206.41@tcp:101:bash.0 Request processed in 7829us (8526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832919.177628:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 48 00000100:00100000:3.0:1788832919.177847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832919.178272:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975435776 00000100:00100000:0.0:1788832919.178281:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975435776 00010000:00010000:0.0:1788832919.178312:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000229b63d6/0xd270a10c1c6a54e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55604 expref: 7 pid: 6699 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832919.178352:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 62 00000100:00100000:0.0:1788832919.178361:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975435776:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832919.178374:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832919.178395:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000229b63d6/0xd270a10c1c6a54e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55604 expref: 7 pid: 6699 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.178409:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000229b63d6/0xd270a10c1c6a54e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55604 expref: 7 pid: 6699 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.178455:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000229b63d6/0xd270a10c1c6a54e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55604 expref: 7 pid: 6699 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.178470:0:7639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832919.178474:0:7639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832919.178481:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.178492:0:7639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.178535:0:7639:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832919.178549:0:7639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b714000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7639:1875726994316288:192.168.206.41@tcp:105: 00000100:00100000:0.0:1788832919.178624:0:7639:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac83840 going to sleep for 11 seconds 00000100:00100000:3.0:1788832919.183796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832919.183921:0:7639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b714000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7639:1875726994316288:192.168.206.41@tcp:105: 00010000:00010000:0.0:1788832919.183943:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832919.183991:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2357:x1875726975435776:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 5630us (6144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832919.184000:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 62 00000100:00100000:2.0:1788832919.184081:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975436032 00000100:00100000:2.0:1788832919.184088:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975436032 00000100:00100000:2.0:1788832919.184135:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 36 00000100:00100000:2.0:1788832919.184144:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:11403:x1875726975436032:12345-192.168.206.41@tcp:35:bash.0 00000100:00100000:2.0:1788832919.184776:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:11403:x1875726975436032:12345-192.168.206.41@tcp:35:bash.0 Request processed in 601us (955us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788832919.184785:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 36 00000100:00100000:2.0:1788832919.190048:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832919.190070:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c05479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994316416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832919.190134:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832919.192319:0:11720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994316416 00000100:00100000:0.0:1788832919.192330:0:11720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994316416 00000100:00080000:1.0:1788832919.192529:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832919.192554:0:11720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788832919.192576:0:11720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994316416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832919.192612:0:11720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832919.192688:0:11720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994316416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (2554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832919.192696:0:11720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788832919.192872:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c05479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994316416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832919.283879:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832919.284010:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975436288 00000100:00100000:2.0:1788832919.284020:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975436288 00000100:00100000:2.0:1788832919.284084:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 144 00000100:00100000:2.0:1788832919.284093:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:11413:x1875726975436288:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832919.284115:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832919.284135:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a54f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55612 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832919.284213:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788832919.284325:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a54f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55612 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.284338:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:2.0:1788832919.284342:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832919.284347:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a54f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55612 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.284360:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702600, rc 0) 00000100:00100000:2.0:1788832919.284419:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:11413:x1875726975436288:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 326us (547us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788832919.284451:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 144 00000100:00100000:2.0:1788832919.288467:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832919.288554:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975436544 00000100:00100000:0.0:1788832919.288563:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975436544 00000100:00100000:0.0:1788832919.288617:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 37 00000100:00100000:0.0:1788832919.288626:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:11413:x1875726975436544:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:0.0:1788832919.288889:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:11413:x1875726975436544:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 263us (428us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788832919.288898:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 37 00000100:00100000:3.0:1788832919.375596:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832919.376926:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975436672 00000100:00100000:0.0:1788832919.376937:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975436672 00000100:00100000:2.0:1788832919.377133:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 145 00000100:00100000:2.0:1788832919.377144:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:11419:x1875726975436672:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832919.377168:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832919.377190:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5504 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55619 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.377250:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a550b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.377264:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a550b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.377276:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a550b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832919.377309:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788832919.377313:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788832919.377329:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a550b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.377352:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5504 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55619 expref: 22 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.377370:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a550b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55619 expref: 21 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.377395:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832919.377398:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832919.377402:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703400, rc 0) 00000100:00100000:2.0:1788832919.377466:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:11419:x1875726975436672:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 323us (1878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832919.377472:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 145 00000100:00100000:3.0:1788832919.382343:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832919.382441:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975436928 00000100:00100000:2.0:1788832919.382451:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975436928 00000100:00100000:2.0:1788832919.382500:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 146 00000100:00100000:2.0:1788832919.382520:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:11419:x1875726975436928:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832919.382539:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832919.382558:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5512 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55620 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.382647:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5519 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.382661:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.382673:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832919.382684:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788832919.382825:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5512 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55620 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.382859:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5519 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55620 expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.382868:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d07e81f00) 00010000:00010000:2.0:1788832919.382871:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832919.382875:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703600, rc 0) 00000100:00100000:2.0:1788832919.382937:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+23:11419:x1875726975436928:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 429us (601us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788832919.382945:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 146 00000100:00100000:0.0:1788832919.386785:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832919.386899:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975437184 00000100:00100000:3.0:1788832919.386909:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975437184 00000100:00100000:3.0:1788832919.386954:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 147 00000100:00100000:3.0:1788832919.386964:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+23:11419:x1875726975437184:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:3.0:1788832919.386986:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832919.387004:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5527 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55627 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.387101:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a552e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.387116:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a552e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.387145:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a552e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832919.387158:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788832919.387264:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5527 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55627 expref: 26 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.387281:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a552e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55627 expref: 25 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.387290:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d07e81f00) 00010000:00010000:3.0:1788832919.387293:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788832919.387297:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2400, rc 0) 00000100:00100000:3.0:1788832919.387354:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+25:11419:x1875726975437184:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 391us (586us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788832919.387362:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 147 00000100:00100000:1.0:1788832919.388175:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832919.388236:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975437312 00000100:00100000:3.0:1788832919.388242:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975437312 00000100:00100000:3.0:1788832919.388283:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:3.0:1788832919.388291:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05479500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+25:2358:x1875726975437312:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832919.388302:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832919.388319:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5519 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55620 expref: 25 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.388331:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d07e81f00) 00010000:00010000:3.0:1788832919.388334:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832919.388381:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05479500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+24:2358:x1875726975437312:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 90us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832919.388389:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:0.0:1788832919.394349:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832919.394573:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975437440 00000100:00100000:3.0:1788832919.394582:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975437440 00000100:00100000:3.0:1788832919.394632:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 49 00000100:00100000:3.0:1788832919.394641:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2360:x1875726975437440:12345-192.168.206.41@tcp:1:lfs.0 00010000:00010000:3.0:1788832919.394679:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.394697:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.394706:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788832919.394711:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832919.394715:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.394764:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.394906:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 6 pid: 6698 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832919.394922:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1875726994316544:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832919.395039:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d2da35600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832919.396914:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1875726994316544:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832919.396946:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832919.398374:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832919.398424:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975437568 00000100:00100000:1.0:1788832919.398432:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975437568 00002000:00100000:1.0:1788832919.398476:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff984d3b716300 x1875726975437568/t0(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:105/0 lens 504/0 e 0 to 0 dl 1788832930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832919.398487:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3b716300 with x1875726975437568 ext(0->12) 00010000:00010000:1.0:1788832919.398496:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 7 pid: 6698 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.398523:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 7 pid: 6698 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788832919.398531:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff984d3b716300 00000100:00100000:1.0:1788832919.398563:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 2 00000100:00100000:1.0:1788832919.398572:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975437568:12345-192.168.206.41@tcp:4:lfs.0 00000100:00100000:1.0:1788832919.399025:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2357:x1875726975437568:12345-192.168.206.41@tcp:4:lfs.0 Request processed in 453us (654us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788832919.399033:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 2 00002000:00100000:1.0:1788832919.399042:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff984d3b716300 x1875726975437568/t4294967305(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:105/0 lens 504/448 e 0 to 0 dl 1788832930 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832919.399052:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3b716300 with x1875726975437568 ext(0->12) 00010000:00010000:1.0:1788832919.399068:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 9 pid: 6698 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.399083:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 9 pid: 6698 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788832919.399096:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff984d3b716300 00000100:00100000:2.0:1788832919.401276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832919.401388:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975437696 00000100:00100000:3.0:1788832919.401396:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975437696 00010000:00010000:3.0:1788832919.401435:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 9 pid: 6698 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832919.401468:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 63 00000100:00100000:3.0:1788832919.401477:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2358:x1875726975437696:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832919.401488:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788832919.401504:0:5840:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788832919.401517:0:5840:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788832919 00002000:00010000:3.0:1788832919.401519:0:5840:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788832919 00002000:00010000:3.0:1788832919.401521:0:5840:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788832919 00010000:00010000:3.0:1788832919.401528:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 9 pid: 6698 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.401542:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 9 pid: 6698 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.401565:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a54ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5560b expref: 9 pid: 6698 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.401581:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832919.401585:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832919.401601:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.401610:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.401642:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832919.401686:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2358:x1875726975437696:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 210us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832919.401693:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 63 00010000:00010000:1.0:1788832919.403411:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.403430:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.403462:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.403471:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.403479:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.403486:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3e00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788832919.403490:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.403500:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.403527:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.403552:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d84d5cc/0xd270a10c1c6a553c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832919.403637:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2360:x1875726975437440:12345-192.168.206.41@tcp:1:lfs.0 Request processed in 8993us (9293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832919.403647:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 49 00000100:00100000:2.0:1788832919.408440:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832919.408989:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975437952 00000100:00100000:0.0:1788832919.409000:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975437952 00000100:00100000:0.0:1788832919.409085:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 38 00000100:00100000:0.0:1788832919.409096:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d033dcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+24:11419:x1875726975437952:12345-192.168.206.41@tcp:35:lfs.0 00000004:00010000:0.0:1788832919.409164:0:5856:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a552e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55627 expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788832919.409386:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788832919.409849:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788832919.414022:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788832919.414113:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.414132:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a54da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555fd expref: 28 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.414141:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.414317:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a54da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555fd expref: 28 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.414337:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a54da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555fd expref: 28 pid: 5853 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832919.414351:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b716680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5856:1875726994316672:192.168.206.41@tcp:104: 00000100:00100000:0.0:1788832919.414599:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac83840 going to sleep for 11 seconds 00000100:00100000:3.0:1788832919.418140:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832919.418270:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975438080 00000100:00100000:1.0:1788832919.418278:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975438080 00010000:00010000:1.0:1788832919.418319:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a54da lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555fd expref: 29 pid: 5853 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832919.418358:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 64 00000100:00100000:1.0:1788832919.418367:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+29:2357:x1875726975438080:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832919.418380:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832919.418386:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a54da lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555fd expref: 29 pid: 5853 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.418399:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a54da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555fd expref: 29 pid: 5853 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.418419:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d07e81f00) 00010000:00010000:1.0:1788832919.418425:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.418442:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.418465:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.418481:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832919.418543:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+29:2357:x1875726975438080:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 177us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832919.418550:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 64 00010000:00010000:0.0:1788832919.419480:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a54da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555fd expref: 28 pid: 5853 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832919.419497:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b716680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5856:1875726994316672:192.168.206.41@tcp:104: 00010000:00010000:0.0:1788832919.419621:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.419631:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832919.419637:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788832919.420215:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788832919.420390:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788832919.420493:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b716680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5856:1875726994316800:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788832919.420558:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832919.420591:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac83480 going to sleep for 11 seconds 00000100:00100000:1.0:1788832919.421168:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994316800 00000100:00100000:1.0:1788832919.421175:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994316800 00000100:00100000:1.0:1788832919.421215:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832919.421223:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1875726994316800:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788832919.421295:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1875726994316800:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 73us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832919.421302:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832919.421546:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b716680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5856:1875726994316800:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788832919.422022:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788832919.422075:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5856:1875726994316928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788832919.422106:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832919.422121:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d92e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832919.422366:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994316928 00000100:00100000:1.0:1788832919.422371:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994316928 00000100:00100000:1.0:1788832919.422392:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788832919.422398:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1875726994316928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788832919.422547:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5856:x1875726994316928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 148us (440us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788832919.422554:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788832919.422854:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5856:1875726994316928:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788832919.422896:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788832919.422929:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.422938:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.422945:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.422962:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832919.422967:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.422974:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.422989:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d07e81f00) 00010000:00010000:2.0:1788832919.422991:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788832919.422996:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.423002:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5543 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788832919.423136:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788832919.423233:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788832919.423242:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 423113497591ns, next at 424113495863ns, rc = 0 00000001:00080000:2.0:1788832919.423247:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788832919.423274:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d07e81f00) 00010000:00010000:2.0:1788832919.423277:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788832919.423283:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a552e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55627 expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832919.423366:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d033dcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+31:11419:x1875726975437952:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 14272us (14942us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788832919.423373:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 38 00000020:00080000:2.0:1788832919.423377:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788832919.429456:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832919.429534:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975438208 00000100:00100000:2.0:1788832919.429544:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975438208 00000100:00100000:2.0:1788832919.429594:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 148 00000100:00100000:2.0:1788832919.429603:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+31:11419:x1875726975438208:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832919.429624:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832919.429644:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a554a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5562e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.429698:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a554a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5562e expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.429718:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a554a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5562e expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.429736:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:2.0:1788832919.429740:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788832919.429768:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702c00, rc 0) 00000100:00100000:2.0:1788832919.429826:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+32:11419:x1875726975438208:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 224us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832919.429833:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 148 00000100:00100000:0.0:1788832919.434338:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832919.434488:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975438464 00000100:00100000:2.0:1788832919.434497:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975438464 00000100:00100000:2.0:1788832919.434561:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 39 00000100:00100000:2.0:1788832919.434570:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+32:11419:x1875726975438464:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:2.0:1788832919.434787:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+33:11419:x1875726975438464:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 218us (456us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788832919.434795:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 39 00000100:00100000:3.0:1788832919.521076:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832919.521262:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975438720 00000100:00100000:1.0:1788832919.521272:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975438720 00000100:00100000:1.0:1788832919.521335:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 149 00000100:00100000:1.0:1788832919.521344:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+33:11429:x1875726975438720:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832919.521381:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832919.521400:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5551 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55635 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832919.521480:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788832919.521602:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5551 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55635 expref: 35 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.521617:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:1.0:1788832919.521620:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832919.521626:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5551 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55635 expref: 35 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.521642:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05e00, rc 0) 00000100:00100000:1.0:1788832919.521741:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+34:11429:x1875726975438720:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 398us (672us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1788832919.521840:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 149 00000100:00100000:3.0:1788832919.525215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832919.525520:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975438848 00000100:00100000:2.0:1788832919.525529:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975438848 00000100:00100000:2.0:1788832919.525607:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 150 00000100:00100000:2.0:1788832919.525616:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+34:11429:x1875726975438848:12345-192.168.206.41@tcp:34:lfs.0 00010000:00010000:2.0:1788832919.525683:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a555f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.525698:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a555f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.525709:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a555f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.525722:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5566 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.525729:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.525735:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.525934:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a556d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.525943:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a556d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.525950:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a556d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788832919.525986:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a556d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526008:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a555f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526015:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a555f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526021:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a555f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526027:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832919.526032:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a555f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526039:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a555f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526050:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832919.526052:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832919.526057:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a555f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526063:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a555f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526074:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526081:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5566 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526087:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526097:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832919.526100:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526106:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5566 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526113:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d0c2cf900) 00010000:00010000:2.0:1788832919.526115:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832919.526118:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5566 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526123:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5566 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526136:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a556d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526142:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a556d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526147:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a556d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526152:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832919.526167:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a556d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526173:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a556d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526189:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:2.0:1788832919.526191:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832919.526194:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a556d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.526201:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a556d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832919.526292:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+34:11429:x1875726975438848:12345-192.168.206.41@tcp:34:lfs.0 Request processed in 676us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832919.526299:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 150 00000100:00100000:0.0:1788832919.529091:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832919.529173:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975439104 00000100:00100000:2.0:1788832919.529183:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975439104 00000100:00100000:2.0:1788832919.529233:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 40 00000100:00100000:2.0:1788832919.529243:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+34:11429:x1875726975439104:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:2.0:1788832919.529485:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+35:11429:x1875726975439104:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 242us (401us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788832919.529492:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 40 00000100:00100000:3.0:1788832919.576460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832919.576559:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975439360 00000100:00100000:1.0:1788832919.576568:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975439360 00000100:00100000:1.0:1788832919.576622:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 151 00000100:00100000:1.0:1788832919.576632:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+35:11432:x1875726975439360:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832919.576655:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832919.576673:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5574 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5563c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.576737:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a557b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.576810:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a557b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.576821:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a557b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.576835:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a5582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.576841:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a5582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.576847:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a5582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.576947:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5589 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.576956:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.576962:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832919.576982:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788832919.577064:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a557b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577071:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a557b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577077:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a557b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577088:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832919.577093:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a557b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577101:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a557b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577112:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:1.0:1788832919.577115:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832919.577119:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a557b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577125:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a557b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577139:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a5582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577145:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a5582 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577151:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a5582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577531:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832919.577534:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a5582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577541:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a5582 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577561:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d02d42b00) 00010000:00010000:1.0:1788832919.577564:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832919.577567:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a5582 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577574:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a5582 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577613:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5574 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5563c expref: 38 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577625:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5589 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5563c expref: 37 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.577633:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:1.0:1788832919.577636:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832919.577638:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05200, rc 0) 00000100:00100000:1.0:1788832919.577685:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+37:11432:x1875726975439360:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 1055us (1233us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788832919.577692:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 151 00000100:00100000:3.0:1788832919.583447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832919.583531:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975439488 00000100:00100000:1.0:1788832919.583541:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975439488 00000100:00100000:1.0:1788832919.583592:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 152 00000100:00100000:1.0:1788832919.583601:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+37:11432:x1875726975439488:12345-192.168.206.41@tcp:54:lfs.0 00010000:00010000:1.0:1788832919.583662:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.583686:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.583709:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.583732:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.583738:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5597 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.583764:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.583769:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832919.583782:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.583790:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.583801:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:1.0:1788832919.583803:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832919.583808:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5597 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.583814:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a5597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832919.583877:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+37:11432:x1875726975439488:12345-192.168.206.41@tcp:54:lfs.0 Request processed in 277us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832919.583885:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 152 00000100:00100000:0.0:1788832919.587029:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832919.587491:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975439744 00000100:00100000:2.0:1788832919.587499:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975439744 00000100:00100000:2.0:1788832919.587559:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 41 00000100:00100000:2.0:1788832919.587568:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+37:11432:x1875726975439744:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:2.0:1788832919.590779:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+38:11432:x1875726975439744:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 3202us (3748us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788832919.590793:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 41 00000100:00100000:3.0:1788832919.857950:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832919.858020:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975440000 00000100:00100000:2.0:1788832919.858041:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975440000 00000100:00100000:2.0:1788832919.858113:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 153 00000100:00100000:2.0:1788832919.858122:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+38:11463:x1875726975440000:12345-192.168.206.41@tcp:101:cat.0 00010000:00010000:2.0:1788832919.858149:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832919.858168:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a559e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55643 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.858254:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a55a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.858267:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a55a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.858277:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a55a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832919.858287:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788832919.858397:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a559e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55643 expref: 41 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.858413:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a55a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55643 expref: 40 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.858421:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:2.0:1788832919.858424:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832919.858427:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703000, rc 0) 00000100:00100000:2.0:1788832919.858483:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+40:11463:x1875726975440000:12345-192.168.206.41@tcp:101:cat.0 Request processed in 362us (1335us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788832919.858490:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 153 00000100:00100000:3.0:1788832919.865692:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832919.865811:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975440256 00000100:00100000:0.0:1788832919.865820:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975440256 00000100:00100000:0.0:1788832919.865869:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 42 00000100:00100000:0.0:1788832919.865878:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+40:11463:x1875726975440256:12345-192.168.206.41@tcp:35:cat.0 00000100:00100000:0.0:1788832919.866105:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+41:11463:x1875726975440256:12345-192.168.206.41@tcp:35:cat.0 Request processed in 227us (420us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788832919.866113:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 42 00000100:00100000:0.0:1788832919.867381:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832919.867459:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975440384 00000100:00100000:1.0:1788832919.867475:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975440384 00000100:00100000:1.0:1788832919.867530:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:1.0:1788832919.867539:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b947100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+41:2358:x1875726975440384:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832919.867550:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832919.867571:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a55a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55643 expref: 41 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.867588:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:1.0:1788832919.867592:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832919.867633:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b947100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+40:2358:x1875726975440384:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 96us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832919.867640:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:3.0:1788832919.939262:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832919.940065:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975440640 00000100:00100000:2.0:1788832919.940075:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975440640 00000100:00100000:2.0:1788832919.940179:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 154 00000100:00100000:2.0:1788832919.940190:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+40:11469:x1875726975440640:12345-192.168.206.41@tcp:101:dd.0 00010000:00010000:2.0:1788832919.940212:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832919.940215:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788832919.940238:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a550b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55619 expref: 40 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.940256:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832919.940260:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832919.940271:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a55b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5564a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.940365:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.940378:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5589 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5563c expref: 40 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.940387:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.940413:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5589 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5563c expref: 40 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.940529:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5589 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5563c expref: 40 pid: 5853 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832919.940560:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994317056:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832919.940647:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832919.944849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832919.945082:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994317056:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832919.945105:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832919.945207:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975440768 00000100:00100000:1.0:1788832919.945213:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975440768 00010000:00010000:1.0:1788832919.945243:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5589 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5563c expref: 41 pid: 5853 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832919.945276:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 65 00000100:00100000:1.0:1788832919.945284:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b945180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+41:2358:x1875726975440768:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832919.945297:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832919.945303:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5589 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5563c expref: 41 pid: 5853 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.945315:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5589 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5563c expref: 41 pid: 5853 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.945335:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5589 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5563c expref: 41 pid: 5853 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.945361:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:1.0:1788832919.945365:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.945375:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.945382:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832919.945409:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832919.945462:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b945180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+40:2358:x1875726975440768:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 178us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832919.945469:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 65 00010000:00010000:3.0:1788832919.945660:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.945667:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832919.945684:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788832919.945839:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a55b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5564a expref: 41 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.945853:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5564a expref: 40 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832919.945867:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:3.0:1788832919.945870:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832919.945872:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702400, rc 0) 00000100:00100000:3.0:1788832919.945895:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+40:11469:x1875726975440640:12345-192.168.206.41@tcp:101:dd.0 Request processed in 5707us (6642us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788832919.945902:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 154 00000100:00100000:0.0:1788832919.948982:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832919.949084:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975441024 00000100:00100000:2.0:1788832919.949093:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975441024 00000100:00100000:2.0:1788832919.949144:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 155 00000100:00100000:2.0:1788832919.949153:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+40:11469:x1875726975441024:12345-192.168.206.41@tcp:36:dd.0 00010000:00010000:2.0:1788832919.949362:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a55c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.949377:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a55c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.949387:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a55c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832919.949888:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788832919.949916:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ec1a6f2 reply state 0000000031bcab4c transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a55c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832919.949925:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832919.949990:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+43:11469:x1875726975441024:12345-192.168.206.41@tcp:36:dd.0 Request processed in 838us (1014us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788832919.949997:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 155 00000020:00080000:2.0:1788832919.950011:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788832919.951912:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a55c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.951925:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a55c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.951932:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a55c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.951938:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832919.951943:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a55c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.951950:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a55c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.951963:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:2.0:1788832919.951966:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832919.951970:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a55c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832919.951976:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a55c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.150077:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832920.239040:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832920.239839:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975441152 00000100:00100000:1.0:1788832920.239849:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975441152 00000100:00100000:1.0:1788832920.240012:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 156 00000100:00100000:1.0:1788832920.240022:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+42:11483:x1875726975441152:12345-192.168.206.41@tcp:101:stat.0 00010000:00010000:1.0:1788832920.240045:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832920.240063:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a55cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55651 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.240123:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a55d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.240137:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a55d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.240165:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a55d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.240179:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a55dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.240186:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a55dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.240193:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a55dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.240266:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a55e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.240276:0:7174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5564a expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.240284:0:7174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a55e4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.240311:0:7174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5564a expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.240324:0:7174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5564a expref: 43 pid: 5854 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832920.240337:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994317184:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832920.240434:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d05305300 going to sleep for 11 seconds 00000100:00100000:0.0:1788832920.248370:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832920.248547:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975441408 00000100:00100000:3.0:1788832920.248555:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975441408 00000100:00100000:3.0:1788832920.248606:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 43 00000100:00100000:3.0:1788832920.248615:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+44:5595:x1875726975441408:12345-192.168.206.41@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788832920.248929:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+45:5595:x1875726975441408:12345-192.168.206.41@tcp:35:ldlm_bl.0 Request processed in 315us (567us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788832920.248938:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 43 00000100:00100000:2.0:1788832920.250010:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c0547bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994317184:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832920.250034:0:7174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a55e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832920.251092:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832920.251177:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975441536 00000100:00100000:1.0:1788832920.251185:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975441536 00010000:00010000:1.0:1788832920.251217:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5564a expref: 45 pid: 5854 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832920.251252:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 66 00000100:00100000:1.0:1788832920.251261:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b947b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+45:2358:x1875726975441536:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832920.251276:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832920.251282:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5564a expref: 45 pid: 5854 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.251295:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5564a expref: 45 pid: 5854 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.251316:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a55ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5564a expref: 45 pid: 5854 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.251333:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:1.0:1788832920.251338:0:7639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a55e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.251346:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a55e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.251354:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a55e4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.251379:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832920.251421:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b947b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+44:2358:x1875726975441536:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 160us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832920.252115:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 66 00010000:00010000:2.0:1788832920.252639:0:7174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a55e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252649:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a55e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832920.252705:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788832920.252709:0:7174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788832920.252726:0:7174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a55e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252739:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a55e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252780:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a55d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252787:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a55d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252794:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a55d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252799:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832920.252803:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a55d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252810:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a55d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252822:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832920.252824:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832920.252828:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a55d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252834:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a55d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252859:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a55dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252865:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a55dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252871:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a55dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252877:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832920.252879:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a55dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.252884:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a55dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.253038:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d02d42b00) 00010000:00010000:2.0:1788832920.253041:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832920.253044:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a55dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.253050:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a55dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.253085:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a55cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55651 expref: 44 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.253098:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a55e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55651 expref: 43 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.253115:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:2.0:1788832920.253117:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832920.253120:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05400, rc 0) 00000100:00100000:2.0:1788832920.253314:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+43:11483:x1875726975441152:12345-192.168.206.41@tcp:101:stat.0 Request processed in 13293us (14281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832920.253322:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 156 00000100:00100000:0.0:1788832920.417373:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832920.417550:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975441792 00000100:00100000:1.0:1788832920.417559:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975441792 00000100:00100000:1.0:1788832920.417613:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 157 00000100:00100000:1.0:1788832920.417622:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+43:11489:x1875726975441792:12345-192.168.206.41@tcp:36:truncate.0 00010000:00010000:1.0:1788832920.417680:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832920.417705:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a55e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55651 expref: 43 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.417725:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:1.0:1788832920.417729:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832920.417952:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a55eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.417966:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a55eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.417975:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a55eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788832920.418015:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1788832920.418035:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099f9b029 reply state 00000000a31f3e0d transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a55eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832920.418044:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832920.418401:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+45:11489:x1875726975441792:12345-192.168.206.41@tcp:36:truncate.0 Request processed in 778us (1035us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788832920.418409:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 157 00000020:00080000:1.0:1788832920.418423:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788832920.420433:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a55eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.420448:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a55eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.420455:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a55eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.420461:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832920.420466:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a55eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.420474:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a55eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.420489:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:1.0:1788832920.420492:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832920.420496:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a55eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.420512:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a55eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832920.641854:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832920.641951:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975441920 00000100:00100000:3.0:1788832920.641959:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975441920 00000100:00100000:3.0:1788832920.642010:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 158 00000100:00100000:3.0:1788832920.642019:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+44:11503:x1875726975441920:12345-192.168.206.41@tcp:101:stat.0 00010000:00010000:3.0:1788832920.642040:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832920.642057:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a55f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55658 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642123:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a55f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642138:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a55f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642160:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a55f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642174:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5600 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642182:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642188:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642260:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5607 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642268:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642275:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832920.642305:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788832920.642309:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788832920.642324:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642335:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642343:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a55f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642359:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a55f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642366:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a55f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642372:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832920.642376:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a55f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642384:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a55f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642396:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:3.0:1788832920.642398:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832920.642403:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a55f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642410:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a55f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642434:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642441:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5600 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642447:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642452:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832920.642459:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642465:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5600 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642473:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d07e81e00) 00010000:00010000:3.0:1788832920.642475:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832920.642478:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5600 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642484:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5600 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642520:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a55f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55658 expref: 46 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642533:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5607 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55658 expref: 45 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.642540:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:3.0:1788832920.642543:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832920.642546:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3e00, rc 0) 00000100:00100000:3.0:1788832920.642601:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+45:11503:x1875726975441920:12345-192.168.206.41@tcp:101:stat.0 Request processed in 583us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832920.642608:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 158 00000040:00080000:0.0:1788832920.794357:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832920.794366:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832920.794557:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788832920.794574:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788832920.795135:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832920.795445:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975442176 00000100:00100000:1.0:1788832920.795454:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975442176 00000100:00100000:1.0:1788832920.795511:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 159 00000100:00100000:1.0:1788832920.795522:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+45:11513:x1875726975442176:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832920.795539:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832920.795558:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a560e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5565f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832920.795641:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788832920.795732:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a560e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5565f expref: 47 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.795782:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:1.0:1788832920.795785:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832920.795801:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a560e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5565f expref: 47 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.795815:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05600, rc 0) 00000100:00100000:1.0:1788832920.795864:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+46:11513:x1875726975442176:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 344us (734us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788832920.795872:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 159 00000100:00100000:0.0:1788832920.801439:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832920.801517:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975442432 00000100:00100000:3.0:1788832920.801525:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975442432 00000100:00100000:3.0:1788832920.801572:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 44 00000100:00100000:3.0:1788832920.801592:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d033df050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+46:11513:x1875726975442432:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:3.0:1788832920.801830:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d033df050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+47:11513:x1875726975442432:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 238us (398us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788832920.801838:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 44 00000100:00100000:0.0:1788832920.879588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832920.879665:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975442688 00000100:00100000:3.0:1788832920.879674:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975442688 00000100:00100000:3.0:1788832920.879732:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 160 00000100:00100000:3.0:1788832920.879776:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+47:11519:x1875726975442688:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:3.0:1788832920.879804:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832920.879822:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a561c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55666 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.879915:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.879928:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5607 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55658 expref: 48 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.879937:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.879975:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5607 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55658 expref: 48 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.879987:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5607 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55658 expref: 48 pid: 5854 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832920.880000:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994317312:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832920.880100:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d2da35c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832920.886015:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994317312:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832920.886042:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832920.886397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832920.887126:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975442816 00000100:00100000:1.0:1788832920.887135:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975442816 00010000:00010000:1.0:1788832920.887168:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5607 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55658 expref: 49 pid: 5854 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832920.887205:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 67 00000100:00100000:1.0:1788832920.887213:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+49:2358:x1875726975442816:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832920.887225:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832920.887232:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5607 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55658 expref: 49 pid: 5854 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.887244:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5607 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55658 expref: 49 pid: 5854 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.887276:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5607 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55658 expref: 49 pid: 5854 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.887289:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:1.0:1788832920.887294:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.887303:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.887310:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.887371:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832920.887418:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+48:2358:x1875726975442816:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 206us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832920.887433:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 67 00010000:00010000:3.0:1788832920.894637:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832920.894653:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832920.894674:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788832920.897707:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a561c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55666 expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.898113:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55666 expref: 48 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.898123:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:2.0:1788832920.898126:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788832920.898129:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2400, rc 0) 00000100:00100000:2.0:1788832920.898241:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+48:11519:x1875726975442688:12345-192.168.206.41@tcp:101:bash.0 Request processed in 18500us (18660us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788832920.898250:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 160 00000100:00100000:0.0:1788832920.911285:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832920.911367:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975443072 00000100:00100000:1.0:1788832920.911376:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975443072 00000100:00100000:1.0:1788832920.911426:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 161 00000100:00100000:1.0:1788832920.911435:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+48:11519:x1875726975443072:12345-192.168.206.41@tcp:36:bash.0 00010000:00010000:1.0:1788832920.911668:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5631 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.911683:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832920.911695:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788832920.911981:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1788832920.912007:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b317b171 reply state 000000001bb509c8 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832920.912016:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832920.913189:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+51:11519:x1875726975443072:12345-192.168.206.41@tcp:36:bash.0 Request processed in 1749us (1907us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788832920.913198:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 161 00000020:00080000:1.0:1788832920.913204:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788832920.929551:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.929566:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5631 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.929574:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5631 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.929598:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832920.929602:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5631 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.929610:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5631 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.929626:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:2.0:1788832920.929629:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832920.929633:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5631 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.929639:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a5631 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832920.947921:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832920.948429:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975443200 00000100:00100000:2.0:1788832920.948438:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975443200 00000100:00100000:2.0:1788832920.948510:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 162 00000100:00100000:2.0:1788832920.948519:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+50:11519:x1875726975443200:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:2.0:1788832920.948542:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832920.948558:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5566d expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.948628:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a563f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.948641:0:7174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55666 expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.948665:0:7174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a563f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.948696:0:7174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55666 expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.948709:0:7174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55666 expref: 51 pid: 5854 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832920.948736:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994317440:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832920.948859:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d776c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832920.959000:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832920.959210:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975443328 00000100:00100000:0.0:1788832920.959219:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975443328 00010000:00010000:0.0:1788832920.959254:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55666 expref: 52 pid: 5854 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832920.959294:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 68 00000100:00100000:0.0:1788832920.959304:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c0547bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:2359:x1875726975443328:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832920.959317:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832920.959325:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55666 expref: 52 pid: 5854 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832920.959338:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55666 expref: 52 pid: 5854 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832920.959360:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:0.0:1788832920.959365:0:7639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a563f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832920.959375:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a563f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832920.959383:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a563f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832920.959415:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832920.959467:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c0547bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:2359:x1875726975443328:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 164us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832920.959475:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 68 00010000:00010000:2.0:1788832920.960003:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5623 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55666 expref: 51 pid: 5854 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832920.960019:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994317440:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832920.960036:0:7174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a563f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.960045:0:7174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a563f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.960050:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a563f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832920.960098:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788832920.960102:0:7174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788832920.960119:0:7174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a563f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.960155:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5566d expref: 51 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.960169:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a563f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5566d expref: 50 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832920.960177:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:2.0:1788832920.960180:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832920.960182:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702a00, rc 0) 00000100:00100000:2.0:1788832920.960206:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+50:11519:x1875726975443200:12345-192.168.206.41@tcp:101:bash.0 Request processed in 11689us (12294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832920.960213:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 162 00000100:00100000:3.0:1788832920.964844:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832920.965008:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975443584 00000100:00100000:0.0:1788832920.965018:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975443584 00000100:00100000:0.0:1788832920.965062:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 45 00000100:00100000:0.0:1788832920.965080:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+50:11519:x1875726975443584:12345-192.168.206.41@tcp:35:bash.0 00000100:00100000:0.0:1788832920.965266:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+51:11519:x1875726975443584:12345-192.168.206.41@tcp:35:bash.0 Request processed in 187us (429us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788832920.965274:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 45 00000100:00100000:3.0:1788832921.093801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832921.094038:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975443840 00000100:00100000:2.0:1788832921.094052:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975443840 00000100:00100000:2.0:1788832921.094153:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 163 00000100:00100000:2.0:1788832921.094165:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+51:11530:x1875726975443840:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832921.094194:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832921.094221:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5646 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55674 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832921.094347:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788832921.094519:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5646 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55674 expref: 53 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.094535:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:2.0:1788832921.094538:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832921.094557:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5646 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55674 expref: 53 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.094572:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703400, rc 0) 00000100:00100000:2.0:1788832921.094649:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:11530:x1875726975443840:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 487us (922us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788832921.094656:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 163 00000100:00080000:1.0:1788832921.095795:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832921.099236:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832921.099318:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975443968 00000100:00100000:0.0:1788832921.099327:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975443968 00000100:00100000:0.0:1788832921.099388:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 164 00000100:00100000:0.0:1788832921.099399:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:11530:x1875726975443968:12345-192.168.206.41@tcp:34:lfs.0 00010000:00010000:0.0:1788832921.099467:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a5654 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.099483:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a5654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.099494:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a5654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.099519:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a565b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.099527:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a565b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.099546:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a565b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.099625:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a5662 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.099633:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a5662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.099639:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a5662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832921.099917:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a5662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.099929:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a5654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.099935:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a5654 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.099941:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a5654 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.099947:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bae00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832921.099951:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a5654 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.099958:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a5654 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100029:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:0.0:1788832921.100038:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832921.100043:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a5654 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100049:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a5654 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100062:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a565b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100067:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a565b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100072:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a565b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100076:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bac00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832921.100078:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a565b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100083:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a565b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100089:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d03c60400) 00010000:00010000:0.0:1788832921.100091:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832921.100094:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a565b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100098:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a565b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100110:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a5662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100120:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a5662 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100125:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a5662 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100129:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bba00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832921.100132:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a5662 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100138:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a5662 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100146:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:0.0:1788832921.100148:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832921.100151:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a5662 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.100156:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a5662 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832921.100228:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:11530:x1875726975443968:12345-192.168.206.41@tcp:34:lfs.0 Request processed in 830us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832921.100235:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 164 00000100:00100000:0.0:1788832921.105796:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832921.106678:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975444224 00000100:00100000:3.0:1788832921.106688:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975444224 00000100:00100000:3.0:1788832921.106785:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 46 00000100:00100000:3.0:1788832921.106797:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:11530:x1875726975444224:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:3.0:1788832921.107005:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+53:11530:x1875726975444224:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 210us (1215us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788832921.107013:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 46 00010000:00010000:2.0:1788832921.174084:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832921.194207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832921.194723:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975444480 00000100:00100000:2.0:1788832921.194737:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975444480 00000100:00100000:2.0:1788832921.194865:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 165 00000100:00100000:2.0:1788832921.194878:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+53:11533:x1875726975444480:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832921.194908:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832921.194932:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5669 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5567b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195028:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5670 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195045:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5670 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195058:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5670 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195074:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5677 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195082:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195111:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195265:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a567e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195276:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a567e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195283:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a567e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832921.195294:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788832921.195939:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5670 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195949:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5670 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195956:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5670 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195963:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832921.195968:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5670 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195976:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5670 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.195990:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832921.195993:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832921.196013:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5670 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.196020:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5670 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.196034:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.196039:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5677 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.196045:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.196050:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832921.196053:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.196058:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5677 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.196065:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d0c2cf900) 00010000:00010000:2.0:1788832921.196067:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832921.196069:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5677 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.196075:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5677 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.196121:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5669 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5567b expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.196144:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a567e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5567b expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.196151:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:2.0:1788832921.196153:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832921.196155:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702400, rc 0) 00000100:00100000:2.0:1788832921.196234:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:11533:x1875726975444480:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 1360us (2041us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788832921.196241:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 165 00000100:00100000:1.0:1788832921.202252:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832921.202386:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975444608 00000100:00100000:2.0:1788832921.202400:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975444608 00000100:00100000:2.0:1788832921.202493:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 166 00000100:00100000:2.0:1788832921.202517:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c0547b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:11533:x1875726975444608:12345-192.168.206.41@tcp:54:lfs.0 00010000:00010000:2.0:1788832921.202605:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a568c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.202627:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a568c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.202641:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a568c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.202680:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a568c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.202688:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a568c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.202717:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a568c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.202724:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832921.202729:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a568c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.202736:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a568c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.203230:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:2.0:1788832921.203236:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832921.203242:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a568c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.203259:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a568c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832921.203362:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c0547b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:11533:x1875726975444608:12345-192.168.206.41@tcp:54:lfs.0 Request processed in 847us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832921.203371:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 166 00000100:00100000:0.0:1788832921.213899:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832921.213942:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832921.214040:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975444736 00000100:00100000:1.0:1788832921.214053:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975444736 00000100:00100000:1.0:1788832921.214129:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00100000:1.0:1788832921.214141:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:2358:x1875726975444736:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832921.214160:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832921.214192:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a567e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5567b expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832921.214215:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:1.0:1788832921.214220:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832921.214296:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:2358:x1875726975444736:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 157us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832921.214319:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00100000:3.0:1788832921.216342:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975444992 00000100:00100000:3.0:1788832921.216361:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975444992 00000100:00100000:3.0:1788832921.216453:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 47 00000100:00100000:3.0:1788832921.216464:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:11533:x1875726975444992:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:3.0:1788832921.218925:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:11533:x1875726975444992:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 2448us (4967us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788832921.218962:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 47 00000001:00080000:0.0:1788832921.317699:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1788832921.317720:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1788832921.464323:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832921.464572:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975445248 00000100:00100000:3.0:1788832921.464586:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975445248 00000100:00100000:3.0:1788832921.464666:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 167 00000100:00100000:3.0:1788832921.464679:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:11551:x1875726975445248:12345-192.168.206.41@tcp:101:cat.0 00010000:00010000:3.0:1788832921.464711:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832921.464738:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5693 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55682 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.465159:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a569a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.465178:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a569a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.465193:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a569a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832921.465205:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788832921.465557:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5693 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55682 expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.465580:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a569a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55682 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.465589:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:3.0:1788832921.465593:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788832921.465597:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2600, rc 0) 00000100:00100000:3.0:1788832921.465804:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:11551:x1875726975445248:12345-192.168.206.41@tcp:101:cat.0 Request processed in 1126us (1506us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788832921.465813:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 167 00000100:00100000:1.0:1788832921.491916:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832921.492160:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975445376 00000100:00100000:0.0:1788832921.492174:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975445376 00000100:00100000:0.0:1788832921.492253:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 168 00000100:00100000:0.0:1788832921.492266:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c0547a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:11552:x1875726975445376:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788832921.492298:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832921.492325:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a56a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55689 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.492414:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a56af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.492444:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a56af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.492457:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a56af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832921.492514:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788832921.492519:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788832921.492541:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a56af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.492571:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a56a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55689 expref: 59 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.492595:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a56af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55689 expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.492605:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:0.0:1788832921.492608:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832921.492622:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036baa00, rc 0) 00000100:00100000:0.0:1788832921.492702:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c0547a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+58:11552:x1875726975445376:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 438us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832921.492710:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 168 00000100:00100000:0.0:1788832921.499401:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832921.500094:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975445760 00000100:00100000:3.0:1788832921.500108:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975445760 00000100:00100000:3.0:1788832921.500181:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 48 00000100:00100000:3.0:1788832921.500192:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+58:11552:x1875726975445760:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:3.0:1788832921.500721:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:11552:x1875726975445760:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 528us (1329us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788832921.500729:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 48 00000100:00100000:3.0:1788832921.502509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832921.502667:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975445888 00000100:00100000:2.0:1788832921.502679:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975445888 00000100:00100000:0.0:1788832921.502856:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:0.0:1788832921.502872:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:11552:x1875726975445888:12345-192.168.206.41@tcp:103:lfs.0 00010000:00010000:0.0:1788832921.502892:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788832921.502924:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a563f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5566d expref: 59 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.503016:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a569a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55682 expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.503028:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a554a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5562e expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.503037:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf300) 00010000:00010000:0.0:1788832921.503050:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832921.503118:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+56:11552:x1875726975445888:12345-192.168.206.41@tcp:103:lfs.0 Request processed in 252us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832921.503125:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:1.0:1788832921.506099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832921.506205:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975446016 00000100:00100000:2.0:1788832921.506217:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975446016 00000100:00100000:2.0:1788832921.506292:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 169 00000100:00100000:2.0:1788832921.506315:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+56:11552:x1875726975446016:12345-192.168.206.41@tcp:58:lfs.0 00010000:00010000:2.0:1788832921.506629:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a56b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.506659:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a56b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.506673:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a56b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788832921.507135:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788832921.507315:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+56:11552:x1875726975446016:12345-192.168.206.41@tcp:58:lfs.0 Request processed in 1001us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832921.507326:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 169 00000100:00100000:2.0:1788832921.535873:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832921.536069:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975446144 00000100:00100000:0.0:1788832921.536083:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975446144 00000100:00100000:0.0:1788832921.536159:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 170 00000100:00100000:0.0:1788832921.536172:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+56:11554:x1875726975446144:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788832921.536198:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832921.536242:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a56bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55690 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536331:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536348:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536363:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536380:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a56cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536387:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a56cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536393:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a56cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536524:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a56d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536535:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a56d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536543:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a56d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832921.536589:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788832921.536595:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788832921.536619:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a56d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536640:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a56d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536650:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536657:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536664:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536671:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832921.536676:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536685:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536699:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:0.0:1788832921.536703:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832921.536708:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536715:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536730:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a56cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536737:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a56cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536813:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a56cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536818:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832921.536821:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a56cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536828:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a56cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536837:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d03c60400) 00010000:00010000:0.0:1788832921.536840:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832921.536843:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a56cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536850:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a56cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536890:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a56bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55690 expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536904:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a56d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55690 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.536911:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf900) 00010000:00010000:0.0:1788832921.536914:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832921.536916:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036ba800, rc 0) 00000100:00100000:0.0:1788832921.537078:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:11554:x1875726975446144:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 908us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832921.537097:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 170 00000040:00080000:0.0:1788832921.814963:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832921.814975:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832921.815014:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788832921.815021:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832921.815180:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875726994317568:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832921.815933:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac83c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832921.837694:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875726994317568:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788832921.838897:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832921.839226:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975446272 00000100:00100000:2.0:1788832921.839238:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975446272 00000100:00100000:2.0:1788832921.839319:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 171 00000100:00100000:2.0:1788832921.839331:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:11565:x1875726975446272:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788832921.839371:0:5855:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788832921.839527:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:11565:x1875726975446272:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 Request processed in 197us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832921.839535:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 171 00000100:00100000:2.0:1788832921.846533:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832921.846677:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975446400 00000100:00100000:0.0:1788832921.846691:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975446400 00000100:00100000:0.0:1788832921.846791:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 172 00000100:00100000:0.0:1788832921.846803:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:11565:x1875726975446400:12345-192.168.206.41@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788832921.846903:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.846926:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.846940:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.846970:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a56e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.846978:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a56e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.846984:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a56e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847034:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a56e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847043:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a56e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847050:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a56e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832921.847093:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788832921.847098:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788832921.847113:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a56e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847125:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847132:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847139:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847145:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832921.847150:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847157:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847184:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d02d42000) 00010000:00010000:0.0:1788832921.847193:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832921.847200:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847206:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba200/0xd270a10c1c6a56d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847221:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a56e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847228:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a56e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847234:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a56e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847368:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bae00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832921.847374:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a56e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847381:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a56e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847390:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff984d03c60400) 00010000:00010000:0.0:1788832921.847393:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832921.847396:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a56e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847401:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bae00/0xd270a10c1c6a56e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847427:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a56e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847440:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a56e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847446:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a56e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847451:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bac00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832921.847454:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a56e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847461:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a56e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847469:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf900) 00010000:00010000:0.0:1788832921.847471:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832921.847474:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a56e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.847480:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a56e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832921.847576:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:11565:x1875726975446400:12345-192.168.206.41@tcp:34:lhsmtool_posix.0 Request processed in 775us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832921.847585:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 172 00000100:00100000:0.0:1788832921.850301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832921.850716:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975446656 00000100:00100000:2.0:1788832921.850729:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975446656 00000100:00100000:2.0:1788832921.850856:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 173 00000100:00100000:2.0:1788832921.850868:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:11565:x1875726975446656:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832921.850896:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832921.850923:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a56ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55697 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.851189:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a56f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.851206:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a56f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.851219:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a56f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832921.851232:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788832921.851617:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a56f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.851626:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a56f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.851633:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a56f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.851639:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832921.851644:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a56f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.851651:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a56f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.851666:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf900) 00010000:00010000:2.0:1788832921.851668:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832921.851675:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a56f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.851693:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a56f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.852353:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a56ee lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55697 expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.852368:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d02d42000) 00010000:00010000:2.0:1788832921.852371:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832921.852375:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a56ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55697 expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.852388:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702000, rc 0) 00000100:00100000:2.0:1788832921.852480:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+58:11565:x1875726975446656:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 1614us (2191us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788832921.852489:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 173 00000100:00100000:3.0:1788832921.861275:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832921.861435:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975446784 00000100:00100000:0.0:1788832921.861448:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975446784 00000100:00100000:0.0:1788832921.861534:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 174 00000100:00100000:0.0:1788832921.861547:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+58:11565:x1875726975446784:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788832921.861613:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788832921.861786:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+58:11565:x1875726975446784:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 Request processed in 242us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832921.861795:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 174 00000100:00100000:1.0:1788832921.873128:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832921.877898:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975447040 00000100:00100000:3.0:1788832921.877920:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975447040 00000100:00100000:3.0:1788832921.878026:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 175 00000100:00100000:3.0:1788832921.878040:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+58:11565:x1875726975447040:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832921.878066:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832921.878070:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788832921.878105:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a56af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55689 expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.878127:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:3.0:1788832921.878132:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832921.878150:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5703 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5569e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788832921.878893:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788832921.879143:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a570a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.879162:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a570a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.879174:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a570a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.879259:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5703 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5569e expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.879280:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a570a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5569e expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.879289:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff984d07e81e00) 00010000:00010000:3.0:1788832921.879292:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832921.879296:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2200, rc 0) 00000100:00100000:3.0:1788832921.879387:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:11565:x1875726975447040:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 1350us (6275us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788832921.879397:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 175 00000100:00100000:3.0:1788832921.884596:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832921.885191:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975447296 00000100:00100000:2.0:1788832921.885205:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975447296 00000100:00100000:2.0:1788832921.887639:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 176 00000100:00100000:2.0:1788832921.887670:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:11565:x1875726975447296:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788832921.887780:0:7174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832921.887817:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a570a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5569e expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.887842:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff984d07e81e00) 00010000:00010000:2.0:1788832921.887854:0:7174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832921.887885:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5718 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.887916:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5718 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.887928:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5718 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.892352:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a571f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfb725d19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.892376:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a571f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb725d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.892389:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a571f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb725d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893622:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5718 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893636:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5718 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893643:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5718 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893649:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832921.893653:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5718 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893661:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5718 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893677:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832921.893695:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832921.893701:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5718 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893707:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5718 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893722:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a571f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb725d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893727:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a571f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb725d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893733:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a571f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb725d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893737:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832921.893740:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a571f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb725d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893762:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a571f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb725d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893771:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfb725d19 (ffff984d0c2cf100) 00010000:00010000:2.0:1788832921.893774:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832921.893777:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a571f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfb725d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.893783:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a571f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfb725d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832921.893900:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+58:11565:x1875726975447296:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 6241us (9315us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788832921.893916:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 176 00000100:00100000:1.0:1788832921.909959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832921.910041:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975447424 00000100:00100000:2.0:1788832921.910055:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975447424 00000100:00100000:2.0:1788832921.910123:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 177 00000100:00100000:2.0:1788832921.910135:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c05478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+58:11565:x1875726975447424:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832921.910162:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832921.910192:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5726 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b556a5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.910238:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a572d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.910267:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a572d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.910280:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a572d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.910402:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556a5 expref: 60 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.910424:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a572d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556a5 expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.910434:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff984d0c2cf000) 00010000:00010000:2.0:1788832921.910437:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788832921.910441:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702000, rc 0) 00000100:00100000:2.0:1788832921.910535:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c05478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:11565:x1875726975447424:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 401us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832921.910551:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 177 00000100:00100000:1.0:1788832921.915552:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832921.915639:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975447680 00000100:00100000:2.0:1788832921.915652:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975447680 00000100:00100000:2.0:1788832921.915722:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 178 00000100:00100000:2.0:1788832921.915734:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c0547bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:11565:x1875726975447680:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788832921.915868:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5734 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.915888:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5734 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.915903:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5734 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788832921.916266:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1788832921.916279:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 425606534281ns, next at 426606531081ns, rc = 0 00000004:00010000:2.0:1788832921.916381:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5b99d5e reply state 00000000c5d1a1de transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5734 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832921.916393:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832921.916532:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c0547bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:11565:x1875726975447680:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 798us (993us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788832921.916541:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 178 00010000:00010000:2.0:1788832921.918490:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5734 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.918525:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5734 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.918555:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5734 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.918562:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832921.918567:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5734 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.918575:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5734 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.918594:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff984d0c2cf000) 00010000:00010000:2.0:1788832921.918598:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788832921.918603:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5734 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832921.918609:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a5734 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832921.925018:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832921.925517:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975447808 00000100:00100000:3.0:1788832921.925532:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975447808 00000100:00100000:3.0:1788832921.925608:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 179 00000100:00100000:3.0:1788832921.925621:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+60:11565:x1875726975447808:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832921.925676:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832921.925702:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a573b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b556ac expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.925950:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a573b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ac expref: 61 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.925980:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a573b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ac expref: 61 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.926003:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff984d0c2cf000) 00010000:00010000:3.0:1788832921.926006:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832921.926011:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3800, rc 0) 00000100:00100000:3.0:1788832921.926091:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:11565:x1875726975447808:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 472us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832921.926099:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 179 00000100:00100000:1.0:1788832921.936946:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832921.938385:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975447936 00000100:00100000:2.0:1788832921.938402:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975447936 00000100:00100000:2.0:1788832921.938483:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 50 00000100:00100000:2.0:1788832921.938505:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2357:x1875726975447936:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788832921.938960:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975447936:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 Request processed in 466us (2022us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788832921.938969:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 50 00000100:00080000:1.0:1788832921.940897:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832921.943590:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832921.943681:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975448192 00000100:00100000:1.0:1788832921.943695:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975448192 00000100:00100000:1.0:1788832921.943797:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 49 00000100:00100000:1.0:1788832921.943809:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:11565:x1875726975448192:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788832921.944115:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+62:11565:x1875726975448192:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 307us (539us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788832921.944124:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 49 00000100:00100000:1.0:1788832921.947462:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832921.947884:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975448448 00000100:00100000:3.0:1788832921.947896:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975448448 00000100:00100000:3.0:1788832921.947957:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 180 00000100:00100000:3.0:1788832921.947967:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+62:11565:x1875726975448448:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788832921.948111:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+62:11565:x1875726975448448:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 145us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832921.948120:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 180 00000100:00100000:1.0:1788832921.952562:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832921.959443:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975448576 00000100:00100000:3.0:1788832921.959463:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975448576 00000100:00100000:3.0:1788832921.959550:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 181 00000100:00100000:3.0:1788832921.959562:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+62:11565:x1875726975448576:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832921.959599:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832921.959625:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5742 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b556b3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.959733:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.959772:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.959786:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832921.959832:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788832921.959854:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.959885:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5742 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556b3 expref: 64 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.959902:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556b3 expref: 63 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.959912:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff984d0c2cf000) 00010000:00010000:3.0:1788832921.959915:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788832921.959920:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3400, rc 0) 00000100:00100000:3.0:1788832921.960010:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+63:11565:x1875726975448576:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 449us (7461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832921.960019:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 181 00000100:00100000:0.0:1788832921.963567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832921.963653:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975448704 00000100:00100000:3.0:1788832921.963665:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975448704 00000100:00100000:3.0:1788832921.963733:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 51 00000100:00100000:3.0:1788832921.963763:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975448704:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832921.963788:0:8475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832921.963818:0:8475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a5750 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b556ba expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832921.963849:0:8475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f6c9a, blocks: 0x1 00010000:00010000:3.0:1788832921.963873:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1788832921.963878:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832921.963889:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a5750 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ba expref: 8 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.963911:0:8475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a5750 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ba expref: 8 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.963928:0:8475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2200, rc 0) 00000100:00100000:3.0:1788832921.964004:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2358:x1875726975448704:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 262us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832921.964011:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 51 00000100:00100000:3.0:1788832921.971923:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832921.972089:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975448960 00000100:00100000:1.0:1788832921.972102:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975448960 00000100:00100000:1.0:1788832921.972181:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 182 00000100:00100000:1.0:1788832921.972193:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+63:11565:x1875726975448960:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788832921.972346:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+63:11565:x1875726975448960:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 155us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832921.972355:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 182 00000100:00100000:2.0:1788832921.979165:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832921.979253:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975449088 00000100:00100000:1.0:1788832921.979265:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975449088 00000100:00100000:1.0:1788832921.979482:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 52 00000100:00100000:1.0:1788832921.979502:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:11565:x1875726975449088:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832921.979543:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832921.979566:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5757 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b556c1 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832921.979603:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a5750 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ba expref: 9 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832921.979613:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832921.979617:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832921.979623:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5757 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c1 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832921.979660:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a5750 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ba expref: 9 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832921.979675:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a5750 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ba expref: 9 pid: 8475 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832921.979691:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c067fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1875726994317696:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832921.979837:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c07b8c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832921.983203:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832921.984917:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c067fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1875726994317696:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832921.984967:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5757 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c1 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832921.985010:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04a00, rc 0) 00000100:00100000:3.0:1788832921.985169:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:11565:x1875726975449088:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 5676us (6015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832921.985180:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 52 00000100:00100000:0.0:1788832921.985677:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975449216 00000100:00100000:0.0:1788832921.985689:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975449216 00010000:00010000:0.0:1788832921.985730:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a5750 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ba expref: 9 pid: 8475 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832921.985784:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 69 00000100:00100000:0.0:1788832921.985794:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2357:x1875726975449216:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832921.985812:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832921.985839:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a5750 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ba expref: 9 pid: 8475 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.985855:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a5750 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ba expref: 9 pid: 8475 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.985882:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c750c4ee/0xd270a10c1c6a5750 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ba expref: 9 pid: 8475 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.985899:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832921.985903:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832921.985920:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5757 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c1 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.985932:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5757 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c1 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832921.985975:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5757 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c1 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832921.985991:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5838:1875726994317824:192.168.206.41@tcp:105: 00000100:00100000:0.0:1788832921.986089:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac836c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832921.992773:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832921.992908:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975449344 00000100:00100000:3.0:1788832921.992920:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975449344 00002000:00100000:3.0:1788832921.992991:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff984c067fdc00 x1875726975449344/t0(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:107/0 lens 504/0 e 0 to 0 dl 1788832932 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788832921.993003:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984c067fdc00 with x1875726975449344 ext(0->8) 00002000:00010000:3.0:1788832921.993011:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984c067fdc00 00000100:00100000:3.0:1788832921.993046:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 4 00000100:00100000:3.0:1788832921.993056:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2357:x1875726975449344:12345-192.168.206.41@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788832921.993636:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:2357:x1875726975449344:12345-192.168.206.41@tcp:4:lhsmtool_posix.0 Request processed in 577us (888us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788832921.993646:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 4 00002000:00100000:3.0:1788832921.993654:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff984c067fdc00 x1875726975449344/t4294967314(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:107/0 lens 504/448 e 0 to 0 dl 1788832932 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788832921.993663:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984c067fdc00 with x1875726975449344 ext(0->8) 00002000:00010000:3.0:1788832921.993667:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984c067fdc00 00000100:00100000:0.0:1788832921.994065:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5838:1875726994317824:192.168.206.41@tcp:105: 00010000:00010000:0.0:1788832921.994099:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832921.994166:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:2357:x1875726975449216:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 8372us (10975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832921.994175:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 69 00000100:00100000:0.0:1788832921.998812:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832921.998858:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975449472 00000100:00100000:0.0:1788832921.998869:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975449472 00000100:00100000:0.0:1788832921.998934:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 183 00000100:00100000:0.0:1788832921.998946:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+63:11565:x1875726975449472:12345-192.168.206.41@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788832922.093104:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+63:11565:x1875726975449472:12345-192.168.206.41@tcp:44:lhsmtool_posix.0 Request processed in 94142us (94283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832922.093138:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 183 00000001:00080000:3.0:1788832922.093194:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967450 is committed 00000001:00080000:3.0:1788832922.093228:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788832922.093250:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1788832922.093367:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788832922.093385:0:5875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984d06d92480 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788832922.093390:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d3a143400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984d06d92300 00000020:00080000:3.0:1788832922.093394:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d3a143200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984d3abb1c00 00000020:00080000:3.0:1788832922.093818:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788832922.094026:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788832922.094049:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994317952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788832922.094120:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832922.094186:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832922.094193:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994318080:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788832922.094219:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832922.094256:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994317952 00000100:00100000:3.0:1788832922.096595:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994317952 00000100:00100000:3.0:1788832922.096705:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994318080 00000100:00100000:3.0:1788832922.096714:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994318080 00000100:00100000:3.0:1788832922.097003:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788832922.097020:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994317952:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788832922.098062:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832922.098069:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788832922.098108:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788832922.098123:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994318080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788832922.098155:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1788832922.098194:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f6c97, atime: 0x6a9f6c97, ctime: 0x6a9f6c97, blocks: 0xb 00010000:00010000:2.0:1788832922.098204:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a575e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.098224:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788832922.098229:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832922.098236:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a575e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832922.098419:0:8475:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788832922.098423:0:8475:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788832922 00002000:00010000:3.0:1788832922.098426:0:8475:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788832922.098428:0:8475:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788832922 -> 1788832922 00002000:00010000:3.0:1788832922.098430:0:8475:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788832922.098545:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1875726994317952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1529us (4423us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788832922.098553:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:2.0:1788832922.098872:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a575e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.098886:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a575e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.098894:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a575e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.098921:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788832922.099481:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832922.099491:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a575e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.099525:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788832922.099530:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a575e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.099541:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a575e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.099563:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a575e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.099571:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a575e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.099596:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832922.099598:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832922.099600:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788832922.099876:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984d3b945180/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788832922.099888:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994317952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788832922.102140:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1875726994318080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4010us (7907us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788832922.102156:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788832922.102294:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788832922.102301:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788832922.102332:0:3316:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff984d3b947b80 x1875726994318080/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788832938 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788832922.102346:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984d3b947b80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788832922.102366:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994318080:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788832922.102891:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832922.103132:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975449600 00000100:00100000:0.0:1788832922.103142:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975449600 00000100:00100000:0.0:1788832922.103198:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 55 00000100:00100000:0.0:1788832922.103208:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:2358:x1875726975449600:12345-192.168.206.41@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788832922.168408:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:2358:x1875726975449600:12345-192.168.206.41@tcp:16:lhsmtool_posix.0 Request processed in 65186us (65505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832922.168425:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 55 00000001:00080000:3.0:1788832922.168953:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1788832922.168969:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1788832922.168975:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1788832922.172214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832922.174979:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975449856 00000100:00100000:2.0:1788832922.174996:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975449856 00000100:00100000:2.0:1788832922.175711:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 184 00000100:00100000:2.0:1788832922.175727:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:11565:x1875726975449856:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788832922.175848:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832922.175883:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3400/0xd270a10c1c6a5749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556b3 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.175904:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff984d0c2cf000) 00010000:00010000:2.0:1788832922.175910:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832922.175954:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5765 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.175970:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.175982:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788832922.176515:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d10763e7 reply state 000000004c7579d8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832922.176528:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832922.176648:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:11565:x1875726975449856:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 926us (4448us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788832922.176655:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 184 00000100:00100000:1.0:1788832922.182503:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00010000:00010000:3.0:1788832922.183024:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.183041:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5765 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.183051:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5765 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.183058:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832922.183064:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5765 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.183074:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5765 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.183095:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff984d0c2cf000) 00010000:00010000:3.0:1788832922.183099:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832922.183104:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5765 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.183111:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5765 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832922.183154:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975449984 00000100:00100000:3.0:1788832922.183179:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975449984 00000100:00100000:3.0:1788832922.183859:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 56 00000100:00100000:3.0:1788832922.183875:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975449984:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788832922.184182:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788832922.184186:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788832922 -> 1788832921 00002000:00010000:3.0:1788832922.184189:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788832919 00002000:00010000:3.0:1788832922.184191:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788832922 -> 1788832921 00002000:00010000:3.0:1788832922.184193:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788832922.186737:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2358:x1875726975449984:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 Request processed in 2854us (4243us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788832922.186776:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 56 00010000:00010000:0.0:1788832922.199162:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832922.199388:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832922.199689:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975450240 00000100:00100000:3.0:1788832922.199702:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975450240 00000100:00100000:2.0:1788832922.199957:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 185 00000100:00100000:2.0:1788832922.199973:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:11565:x1875726975450240:12345-192.168.206.41@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788832922.200065:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.200101:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a572d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556a5 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.200111:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.200157:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a572d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556a5 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.200172:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a572d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556a5 expref: 18 pid: 5855 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832922.200189:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994318208:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832922.200326:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d776c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832922.202936:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994318208:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832922.202975:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832922.205037:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832922.205134:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975450368 00000100:00100000:2.0:1788832922.205148:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975450368 00010000:00010000:2.0:1788832922.205196:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a572d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556a5 expref: 19 pid: 5855 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832922.205236:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 70 00000100:00100000:2.0:1788832922.205259:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:2358:x1875726975450368:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832922.205278:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832922.205303:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a572d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556a5 expref: 19 pid: 5855 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.205331:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a572d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556a5 expref: 19 pid: 5855 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.205359:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a572d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556a5 expref: 19 pid: 5855 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.205380:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff984d0c2cf000) 00010000:00010000:2.0:1788832922.205387:0:7639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.205398:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.205408:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.205454:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832922.205530:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:2358:x1875726975450368:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 273us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832922.205539:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 70 00010000:00010000:1.0:1788832922.205720:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.205729:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.205801:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.205817:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.205824:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.205830:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832922.205835:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.205842:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.205853:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff984d0c2cf000) 00010000:00010000:1.0:1788832922.205856:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788832922.205860:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.205867:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a576c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832922.205913:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:11565:x1875726975450240:12345-192.168.206.41@tcp:55:lhsmtool_posix.0 Request processed in 5944us (6533us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788832922.205922:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 185 00000100:00100000:3.0:1788832922.211836:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832922.211990:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975450496 00000100:00100000:2.0:1788832922.212003:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975450496 00000100:00100000:2.0:1788832922.212073:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 57 00000100:00100000:2.0:1788832922.212084:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2357:x1875726975450496:12345-192.168.206.41@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788832922.212145:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.212192:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5757 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c1 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.212202:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832922.212207:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832922.212212:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.212268:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5757 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c1 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.212285:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5757 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c1 expref: 8 pid: 6700 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832922.212303:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1875726994318336:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832922.212421:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832922.219344:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832922.219564:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975450624 00000100:00100000:0.0:1788832922.219576:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975450624 00010000:00010000:0.0:1788832922.219624:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5757 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c1 expref: 9 pid: 6700 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832922.219666:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 71 00000100:00100000:0.0:1788832922.219677:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2357:x1875726975450624:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832922.219694:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832922.219721:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5757 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c1 expref: 9 pid: 6700 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.219736:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5757 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c1 expref: 9 pid: 6700 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.219804:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788832922.219810:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788832922.219817:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.219845:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.219870:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832922.219938:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2357:x1875726975450624:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 262us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832922.219947:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 71 00010000:00010000:2.0:1788832922.223814:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5757 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c1 expref: 8 pid: 6700 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832922.223844:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1875726994318336:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832922.223876:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.223889:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.223912:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.223954:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.223962:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.223972:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.223980:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788832922.223985:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.223994:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.224018:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.224027:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5773 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832922.224151:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975450496:12345-192.168.206.41@tcp:1:lhsmtool_posix.0 Request processed in 12067us (12327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832922.224162:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 57 00000100:00100000:2.0:1788832922.233174:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832922.233262:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975450880 00000100:00100000:3.0:1788832922.233275:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975450880 00000100:00100000:3.0:1788832922.233347:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 186 00000100:00100000:3.0:1788832922.233359:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+17:11565:x1875726975450880:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788832922.233628:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a577a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.233652:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a577a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.233666:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a577a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.234114:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.234129:0:7174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a573b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ac expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.234137:0:7174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.234180:0:7174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a573b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ac expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.234195:0:7174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a573b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ac expref: 18 pid: 5855 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832922.234212:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994318464:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832922.234342:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d77840 going to sleep for 11 seconds 00000100:00100000:2.0:1788832922.237003:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832922.237047:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975451008 00000100:00100000:2.0:1788832922.237057:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975451008 00010000:00010000:2.0:1788832922.237106:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a573b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ac expref: 19 pid: 5855 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832922.237168:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 72 00000100:00100000:2.0:1788832922.237179:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:2358:x1875726975451008:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832922.237198:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832922.237207:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a573b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ac expref: 19 pid: 5855 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.237222:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a573b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ac expref: 19 pid: 5855 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.237383:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff984d0c2cf000) 00010000:00010000:2.0:1788832922.237390:0:7639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.237401:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.237410:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.237521:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832922.237582:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:2358:x1875726975451008:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 404us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832922.237588:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 72 00010000:00010000:3.0:1788832922.245615:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a573b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556ac expref: 18 pid: 5855 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832922.245655:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994318464:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832922.245690:0:7174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.245701:0:7174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.245707:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788832922.247394:0:7174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1788832922.247710:0:7174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788832922.248410:0:7174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1788832922.248621:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7174:1875726994318592:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788832922.248708:0:7174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832922.249011:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d2da35000 going to sleep for 11 seconds 00000100:00100000:0.0:1788832922.253078:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994318592 00000100:00100000:0.0:1788832922.253100:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994318592 00000100:00100000:0.0:1788832922.253225:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788832922.253250:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7174:x1875726994318592:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788832922.253434:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7174:x1875726994318592:12345-0@lo:1000:mdt00_003.0 Request processed in 198us (4724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832922.253443:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788832922.253834:0:7174:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788832922.253843:0:7174:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984d3b945180, transno 4294967315 00000100:00100000:2.0:1788832922.253861:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7174:1875726994318592:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788832922.254628:0:7174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788832922.254738:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7174:1875726994318720:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788832922.254853:0:7174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832922.257275:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832922.257371:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994318720 00000100:00100000:3.0:1788832922.257382:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994318720 00000100:00100000:3.0:1788832922.257525:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832922.257537:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7174:x1875726994318720:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788832922.258638:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7174:x1875726994318720:12345-0@lo:1000:mdt00_003.0 Request processed in 1097us (3777us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788832922.258650:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788832922.263048:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7174:1875726994318720:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788832922.263143:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263156:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263189:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263196:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832922.263202:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263211:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263229:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff984d0c2cf000) 00010000:00010000:1.0:1788832922.263233:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832922.263237:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263422:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5781 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263460:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a56b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263467:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a56b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263474:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a56b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263479:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832922.263482:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a56b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263512:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a56b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263522:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf900) 00010000:00010000:1.0:1788832922.263525:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832922.263528:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a56b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263534:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a56b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263560:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263575:0:7174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a56d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55690 expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263585:0:7174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263630:0:7174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a56d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55690 expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.263649:0:7174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a56d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55690 expref: 21 pid: 5854 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832922.263665:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c067fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994318848:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832922.263983:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c07b8c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832922.270668:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832922.270843:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c067fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994318848:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832922.270875:0:7174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832922.271631:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975451136 00000100:00100000:0.0:1788832922.271643:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975451136 00010000:00010000:0.0:1788832922.271689:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a56d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55690 expref: 22 pid: 5854 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832922.271921:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 73 00000100:00100000:0.0:1788832922.271933:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+22:2357:x1875726975451136:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832922.271952:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832922.271960:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a56d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55690 expref: 22 pid: 5854 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.271993:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a56d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55690 expref: 22 pid: 5854 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.272018:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a56d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55690 expref: 22 pid: 5854 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.272034:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf900) 00010000:00010000:0.0:1788832922.272041:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.272052:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.272061:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.272129:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832922.272198:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:2357:x1875726975451136:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 267us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832922.272208:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 73 00010000:00010000:1.0:1788832922.273249:0:7174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273282:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273298:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273306:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273313:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273320:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832922.273325:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273334:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273350:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf900) 00010000:00010000:1.0:1788832922.273353:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832922.273359:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273365:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5788 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273383:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a577a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273389:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a577a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273401:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a577a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273407:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832922.273410:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a577a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273665:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a577a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273675:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf900) 00010000:00010000:1.0:1788832922.273678:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788832922.273681:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a577a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.273687:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2600/0xd270a10c1c6a577a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832922.274214:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:11565:x1875726975450880:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 40851us (41047us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788832922.274227:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 186 00000020:00080000:1.0:1788832922.274233:0:7174:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788832922.274466:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832922.274473:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832922.275020:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788832922.275031:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788832922.277502:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832922.277737:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975451392 00000100:00100000:1.0:1788832922.277777:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975451392 00000100:00100000:1.0:1788832922.277843:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 50 00000100:00100000:1.0:1788832922.277856:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d033dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:11565:x1875726975451392:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788832922.278685:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788832922.278834:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788832922.278901:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a578f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.278920:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a578f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.278934:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a578f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.278943:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a578f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.278949:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a578f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.278955:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a578f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.278971:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788832922.279099:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d033dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+22:11565:x1875726975451392:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 1243us (1614us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788832922.279109:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 50 00000020:00080000:1.0:1788832922.279116:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788832922.280166:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832922.280181:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a578f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.280193:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05a00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788832922.280197:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a578f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.280207:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a578f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.280227:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff984d02d42a00) 00010000:00010000:2.0:1788832922.280230:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788832922.280235:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a578f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.280252:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a578f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.280276:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832922.280278:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832922.280280:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788832922.567509:0:12529:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788832922.567522:0:12529:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788832922.567582:0:12529:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788832922.567589:0:12529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788832922.690634:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832922.690974:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975451648 00000100:00100000:3.0:1788832922.690987:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975451648 00000100:00100000:3.0:1788832922.691065:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 187 00000100:00100000:3.0:1788832922.691077:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+22:11575:x1875726975451648:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:3.0:1788832922.691108:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832922.691133:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b556c8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.691387:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a579d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.691403:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a579d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.691419:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a579d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832922.691431:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788832922.691583:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c8 expref: 25 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.691602:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a579d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c8 expref: 24 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.691611:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:3.0:1788832922.691614:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832922.691619:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3600, rc 0) 00000100:00100000:3.0:1788832922.691699:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+24:11575:x1875726975451648:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 623us (1092us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788832922.691707:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 187 00000100:00100000:1.0:1788832922.695427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832922.695546:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975451776 00000100:00100000:2.0:1788832922.695561:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975451776 00000100:00100000:2.0:1788832922.695652:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 188 00000100:00100000:2.0:1788832922.695664:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+24:11575:x1875726975451776:12345-192.168.206.41@tcp:34:lfs.0 00010000:00010000:2.0:1788832922.695878:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.695903:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.695919:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.695938:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.695945:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.695953:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696257:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a57b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696265:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a57b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696272:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a57b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788832922.696323:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a57b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696339:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696352:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696359:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696366:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832922.696371:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696379:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696392:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832922.696395:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832922.696400:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696406:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696418:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696424:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696430:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696435:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832922.696443:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696450:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696458:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d0c2cf200) 00010000:00010000:2.0:1788832922.696460:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832922.696463:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696470:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696486:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a57b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696503:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a57b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696510:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a57b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696515:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832922.696518:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a57b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696523:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a57b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696531:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d0c2cf400) 00010000:00010000:2.0:1788832922.696533:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832922.696541:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a57b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.696547:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a57b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832922.696657:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+24:11575:x1875726975451776:12345-192.168.206.41@tcp:34:lfs.0 Request processed in 993us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832922.696666:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 188 00000100:00100000:1.0:1788832922.734105:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832922.734153:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975452032 00000100:00100000:1.0:1788832922.734165:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975452032 00000100:00100000:1.0:1788832922.734587:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 189 00000100:00100000:1.0:1788832922.734601:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+24:11578:x1875726975452032:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832922.734626:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832922.734651:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a57c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b556cf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.734739:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a57c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.735109:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a57c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.735123:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a57c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.735142:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a57ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.735150:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a57ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.735157:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a57ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736049:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a57d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736063:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a57d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736072:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a57d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832922.736095:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788832922.736207:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a57c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736215:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a57c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736221:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a57c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736228:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832922.736233:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a57c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736722:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a57c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736738:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:1.0:1788832922.736767:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832922.736774:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a57c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736782:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a57c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736799:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a57ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736806:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a57ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736825:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a57ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736830:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832922.736833:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a57ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736840:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a57ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736849:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d02d42700) 00010000:00010000:1.0:1788832922.736851:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832922.736854:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a57ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736859:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a57ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736919:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a57c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556cf expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736935:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a57d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556cf expref: 26 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.736943:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d02d42400) 00010000:00010000:1.0:1788832922.736945:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832922.736947:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05600, rc 0) 00000100:00100000:1.0:1788832922.737205:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:11578:x1875726975452032:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 2607us (3112us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788832922.737223:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 189 00000100:00100000:1.0:1788832922.741014:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832922.741103:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975452160 00000100:00100000:0.0:1788832922.741116:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975452160 00000100:00100000:0.0:1788832922.741193:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 190 00000100:00100000:0.0:1788832922.741205:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:11578:x1875726975452160:12345-192.168.206.41@tcp:54:lfs.0 00010000:00010000:0.0:1788832922.741293:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a57e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.741314:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a57e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.741341:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a57e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.741372:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a57e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.741379:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a57e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.741386:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a57e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.741392:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832922.741396:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a57e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.741404:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a57e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.742873:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d02d42400) 00010000:00010000:0.0:1788832922.742881:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788832922.742890:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a57e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.742899:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a57e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832922.743018:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:11578:x1875726975452160:12345-192.168.206.41@tcp:54:lfs.0 Request processed in 1810us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832922.743029:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 190 00000100:00100000:1.0:1788832922.749260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832922.749342:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975452416 00000100:00100000:2.0:1788832922.749355:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975452416 00000100:00100000:2.0:1788832922.749431:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 51 00000100:00100000:2.0:1788832922.749442:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:11578:x1875726975452416:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:2.0:1788832922.749720:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+27:11578:x1875726975452416:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 280us (474us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788832922.749729:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 51 00000100:00100000:1.0:1788832922.774540:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d398fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994318976:0@lo:400:kworker.0 00000100:00100000:1.0:1788832922.774638:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832922.774702:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994319488:0@lo:400:kworker.0 00000100:00100000:1.0:1788832922.774730:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832922.774788:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788832922.774795:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b2b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994319104:0@lo:400:kworker.0 00000100:00100000:1.0:1788832922.774818:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832922.774837:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994319616:0@lo:400:kworker.0 00000100:00100000:1.0:1788832922.774861:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832922.774895:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994318976 00000100:00100000:1.0:1788832922.774905:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994318976 00000100:00100000:1.0:1788832922.774962:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788832922.774974:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994318976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832922.775032:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3314:x1875726994318976:12345-0@lo:400:kworker.0 Request processed in 60us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832922.775040:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788832922.775072:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994319488 00000100:00100000:1.0:1788832922.775076:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994319488 00000100:00100000:1.0:1788832922.775119:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994319104 00000100:00100000:1.0:1788832922.775122:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994319104 00000100:00100000:1.0:1788832922.775142:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788832922.775148:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994319488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832922.775202:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994319488:12345-0@lo:400:kworker.0 Request processed in 54us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832922.775209:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788832922.775222:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788832922.775227:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994319104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832922.775252:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994319104:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832922.775258:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788832922.775281:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994319616 00000100:00100000:1.0:1788832922.775284:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994319616 00000100:00100000:1.0:1788832922.775310:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788832922.775317:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875726994319616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832922.775347:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875726994319616:12345-0@lo:400:kworker.0 Request processed in 31us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832922.775354:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788832922.775401:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b2b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994319104:0@lo:400:kworker.0 00000100:00100000:1.0:1788832922.775429:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994319616:0@lo:400:kworker.0 00000100:00100000:1.0:1788832922.775439:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d398fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994318976:0@lo:400:kworker.0 00000100:00100000:1.0:1788832922.775448:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994319488:0@lo:400:kworker.0 00000100:00100000:3.0:1788832922.775846:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994319360:0@lo:400:kworker.0 00000100:00100000:2.0:1788832922.775977:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994319232:0@lo:400:kworker.0 00000100:00100000:2.0:1788832922.776023:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832922.776056:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c067ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994319744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832922.776078:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788832922.776111:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832922.776159:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994319232 00000100:00100000:1.0:1788832922.776167:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994319232 00000100:00100000:3.0:1788832922.776207:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832922.776224:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788832922.776236:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994319232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832922.776292:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994319232:12345-0@lo:400:kworker.0 Request processed in 60us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832922.776309:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788832922.776311:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994319360 00000100:00100000:3.0:1788832922.776321:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994319360 00000100:00100000:3.0:1788832922.776387:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788832922.776398:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1875726994319360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832922.776557:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1875726994319360:12345-0@lo:400:kworker.0 Request processed in 159us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832922.776566:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788832922.776612:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994319744 00000100:00100000:3.0:1788832922.776617:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994319744 00000100:00100000:3.0:1788832922.776666:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788832922.776679:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875726994319744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832922.776697:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788832922.776797:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875726994319744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832922.776804:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788832922.776855:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994319360:0@lo:400:kworker.0 00000100:00080000:2.0:1788832922.777589:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832922.777650:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c067ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994319744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832922.777666:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994319232:0@lo:400:kworker.0 00000100:00100000:1.0:1788832922.785958:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832922.786081:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975452672 00000100:00100000:2.0:1788832922.786094:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975452672 00000100:00100000:2.0:1788832922.786175:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 191 00000100:00100000:2.0:1788832922.786204:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+27:11112:x1875726975452672:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:2.0:1788832922.786237:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832922.786263:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a57ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b556d6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.787010:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.787033:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a57d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556cf expref: 28 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.787043:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.787087:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a57d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556cf expref: 28 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.787104:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a57d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556cf expref: 28 pid: 5853 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832922.787121:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b945180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994319872:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832922.787244:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788832922.793192:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832922.793569:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975452800 00000100:00100000:0.0:1788832922.793599:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975452800 00010000:00010000:0.0:1788832922.793649:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a57d5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556cf expref: 29 pid: 5853 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832922.793701:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 74 00000100:00100000:0.0:1788832922.793711:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+29:2358:x1875726975452800:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832922.793728:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832922.793736:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a57d5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556cf expref: 29 pid: 5853 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.793779:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a57d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556cf expref: 29 pid: 5853 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.793805:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d02d42400) 00010000:00010000:0.0:1788832922.793811:0:7639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.793822:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.793830:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.793852:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832922.793918:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+29:2358:x1875726975452800:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 208us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832922.793927:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 74 00010000:00010000:3.0:1788832922.794348:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a57d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556cf expref: 28 pid: 5853 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832922.794376:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b945180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1875726994319872:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832922.794399:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.794423:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.794429:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832922.794449:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788832922.794603:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a57ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556d6 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.794619:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556d6 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832922.794629:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d02d42400) 00010000:00010000:3.0:1788832922.794632:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832922.794635:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702a00, rc 0) 00000100:00100000:3.0:1788832922.794710:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+28:11112:x1875726975452672:12345-192.168.206.41@tcp:101:bash.0 Request processed in 8509us (8766us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788832922.794720:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 191 00000100:00100000:1.0:1788832922.802200:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832922.802383:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975453056 00000100:00100000:2.0:1788832922.802401:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975453056 00000100:00100000:2.0:1788832922.802943:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 192 00000100:00100000:2.0:1788832922.803022:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+28:11112:x1875726975453056:12345-192.168.206.41@tcp:36:bash.0 00010000:00010000:2.0:1788832922.804154:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.804203:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.804218:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832922.804723:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788832922.805569:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041c4cebd reply state 000000002530973f transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832922.805585:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788832922.805696:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788832922.806573:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+32:11112:x1875726975453056:12345-192.168.206.41@tcp:36:bash.0 Request processed in 3612us (4373us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788832922.806585:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 192 00000020:00080000:2.0:1788832922.806592:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788832922.814358:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.814382:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.814391:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.814398:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832922.814403:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.814412:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.814433:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d02d42400) 00010000:00010000:1.0:1788832922.814437:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832922.814443:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.814449:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702400/0xd270a10c1c6a57ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832922.814737:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832922.814923:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975453184 00000100:00100000:1.0:1788832922.814938:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975453184 00000100:00100000:1.0:1788832922.815011:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 193 00000100:00100000:1.0:1788832922.815039:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+31:11112:x1875726975453184:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:1.0:1788832922.815171:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832922.815199:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5806 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b556dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.815282:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5806 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556dd expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.815297:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5806 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556dd expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.815319:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d02d42400) 00010000:00010000:1.0:1788832922.815323:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832922.815326:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05400, rc 0) 00000100:00100000:1.0:1788832922.815458:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+32:11112:x1875726975453184:12345-192.168.206.41@tcp:101:bash.0 Request processed in 420us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832922.815466:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 193 00000100:00100000:1.0:1788832922.821951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832922.823515:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975453312 00000100:00100000:2.0:1788832922.823535:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975453312 00000100:00100000:1.0:1788832922.823715:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 58 00000100:00100000:1.0:1788832922.823729:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:11112:x1875726975453312:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:1.0:1788832922.823779:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832922.823808:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a580d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b556e4 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788832922.823841:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f6c99, atime: 0x6a9f6c97, ctime: 0x6a9f6c99, blocks: 0xb 00010000:00010000:1.0:1788832922.823878:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1788832922.823901:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832922.823911:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a580d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556e4 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.823933:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a580d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556e4 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.823949:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05a00, rc 0) 00000100:00100000:1.0:1788832922.824019:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:11112:x1875726975453312:12345-192.168.206.41@tcp:101:bash.0 Request processed in 293us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832922.824027:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 58 00000100:00100000:2.0:1788832922.827061:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832922.827129:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975453440 00000100:00100000:0.0:1788832922.827146:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975453440 00002000:00010000:0.0:1788832922.827222:0:6706:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1788832922.827228:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3b945180 with x1875726975453440 ext(0->18446744073709551615) 00002000:00010000:0.0:1788832922.827254:0:6706:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984d3b945180. 00000100:00100000:0.0:1788832922.827295:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 5 00000100:00100000:0.0:1788832922.827306:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2359:x1875726975453440:12345-192.168.206.41@tcp:10:bash.0 00002000:00010000:0.0:1788832922.827736:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788832922.828553:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788832921 -> 1788832923 00002000:00010000:0.0:1788832922.828558:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788832919 -> 1788832919 00002000:00010000:0.0:1788832922.828560:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788832921 -> 1788832923 00002000:00010000:0.0:1788832922.828562:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788832922.829069:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2359:x1875726975453440:12345-192.168.206.41@tcp:10:bash.0 Request processed in 1754us (2006us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788832922.829087:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 5 00002000:00010000:2.0:1788832922.829094:0:6706:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1788832922.829098:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3b945180 with x1875726975453440 ext(0->18446744073709551615) 00002000:00010000:2.0:1788832922.829109:0:6706:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984d3b945180. 00000100:00100000:2.0:1788832922.907994:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832922.908623:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975453568 00000100:00100000:0.0:1788832922.908639:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975453568 00000100:00100000:0.0:1788832922.908727:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 194 00000100:00100000:0.0:1788832922.908739:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+32:11592:x1875726975453568:12345-192.168.206.41@tcp:34:lfs.0 00010000:00010000:0.0:1788832922.908879:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5814 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.908900:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.908914:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.908933:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a581b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.908942:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a581b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.908972:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a581b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909279:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909288:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909296:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832922.909345:0:7174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909359:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909365:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5814 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909372:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909377:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832922.909382:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909389:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5814 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909403:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:0.0:1788832922.909411:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832922.909417:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909424:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909439:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a581b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909445:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a581b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909451:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a581b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909456:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832922.909459:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a581b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909465:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a581b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909473:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d03c60300) 00010000:00010000:0.0:1788832922.909476:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832922.909479:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a581b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909485:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a581b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909511:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909523:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5822 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909529:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909535:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832922.909538:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909545:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909554:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d02d42400) 00010000:00010000:0.0:1788832922.909557:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832922.909560:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5822 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.909566:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832922.909661:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+32:11592:x1875726975453568:12345-192.168.206.41@tcp:34:lfs.0 Request processed in 922us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832922.909670:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 194 00000100:00100000:1.0:1788832922.952461:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832922.952786:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975453824 00000100:00100000:2.0:1788832922.952799:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975453824 00000100:00100000:2.0:1788832922.952884:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 195 00000100:00100000:2.0:1788832922.952911:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+32:11595:x1875726975453824:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832922.952939:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832922.952967:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5829 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b556eb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.953065:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5830 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.953083:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.953097:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.953113:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5837 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.953120:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.953127:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.953949:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a583e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.953965:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a583e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.953975:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a583e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832922.954001:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788832922.954125:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954134:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5830 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954141:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954147:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832922.954152:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954161:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5830 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954176:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832922.954179:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832922.954185:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5830 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954191:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5830 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954207:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954214:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5837 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954231:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954236:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832922.954239:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954247:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5837 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954255:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d0c2cf100) 00010000:00010000:2.0:1788832922.954258:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832922.954484:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5837 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954614:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5837 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954675:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5829 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556eb expref: 35 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954691:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a583e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556eb expref: 34 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.954700:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d02d42400) 00010000:00010000:2.0:1788832922.954703:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788832922.954706:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703600, rc 0) 00000100:00100000:2.0:1788832922.954925:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+34:11595:x1875726975453824:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 2015us (2475us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788832922.954947:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 195 00000100:00100000:1.0:1788832922.959803:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832922.959956:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975453952 00000100:00100000:0.0:1788832922.959969:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975453952 00000100:00100000:0.0:1788832922.960044:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 196 00000100:00100000:0.0:1788832922.960056:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+34:11595:x1875726975453952:12345-192.168.206.41@tcp:54:lfs.0 00010000:00010000:0.0:1788832922.960147:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.960184:0:7174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556d6 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.960195:0:7174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.960239:0:7174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556d6 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832922.960256:0:7174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556d6 expref: 34 pid: 5854 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832922.960272:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994320000:192.168.206.41@tcp:104: 00000100:00100000:0.0:1788832922.960401:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d05305540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832922.965365:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994320000:192.168.206.41@tcp:104: 00010000:00010000:0.0:1788832922.965408:0:7174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832922.965923:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832922.966027:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975454208 00000100:00100000:2.0:1788832922.966036:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975454208 00000100:00100000:2.0:1788832922.966106:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 52 00000100:00100000:2.0:1788832922.966117:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+35:5595:x1875726975454208:12345-192.168.206.41@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788832922.966552:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+36:5595:x1875726975454208:12345-192.168.206.41@tcp:35:ldlm_bl.0 Request processed in 435us (629us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788832922.966562:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 52 00000100:00100000:3.0:1788832922.972136:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832922.972268:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975454336 00000100:00100000:1.0:1788832922.972281:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975454336 00010000:00010000:1.0:1788832922.972334:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556d6 expref: 36 pid: 5854 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832922.972378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 75 00000100:00100000:1.0:1788832922.972389:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06e59850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+36:2357:x1875726975454336:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832922.972406:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832922.972415:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556d6 expref: 36 pid: 5854 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.972429:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556d6 expref: 36 pid: 5854 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.972477:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a57f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556d6 expref: 36 pid: 5854 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.972508:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d02d42400) 00010000:00010000:1.0:1788832922.972514:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.972525:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.972533:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832922.972568:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832922.972652:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06e59850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+35:2357:x1875726975454336:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 263us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832922.972661:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 75 00010000:00010000:2.0:1788832922.973800:0:7174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.973816:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.973858:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.973866:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.973874:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.973881:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832922.973886:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.973894:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.973930:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d02d42400) 00010000:00010000:2.0:1788832922.973934:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832922.973938:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832922.973945:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a584c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832922.974249:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+34:11595:x1875726975453952:12345-192.168.206.41@tcp:54:lfs.0 Request processed in 14189us (14454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832922.974261:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 196 00000100:00100000:0.0:1788832922.983486:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832922.983700:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832922.983733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832922.983788:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832922.983819:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975454464 00000100:00100000:0.0:1788832922.983831:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975454464 00000100:00100000:0.0:1788832922.983888:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 297 00000100:00100000:0.0:1788832922.983899:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2360:x1875726975454464:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832922.984181:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975454592 00000100:00100000:1.0:1788832922.984187:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975454592 00000100:00100000:1.0:1788832922.984235:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975454720 00000100:00100000:1.0:1788832922.984239:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975454720 00000100:00100000:1.0:1788832922.984262:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 75 00000100:00100000:1.0:1788832922.984269:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975454592:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832922.984322:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2360:x1875726975454592:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 53us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832922.984330:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 75 00000100:00100000:1.0:1788832922.984349:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 76 00000100:00100000:1.0:1788832922.984364:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2360:x1875726975454720:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832922.984393:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2360:x1875726975454720:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 30us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832922.984400:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 76 00000100:00080000:1.0:1788832922.984418:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832922.984473:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2360:x1875726975454464:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 575us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832922.984481:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 297 00000100:00100000:0.0:1788832922.984531:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975454848 00000100:00100000:0.0:1788832922.984536:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975454848 00000100:00100000:0.0:1788832922.984584:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 156 00000100:00100000:0.0:1788832922.984589:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975454848:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832922.984620:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2360:x1875726975454848:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 31us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832922.984626:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 156 00000100:00080000:1.0:1788832922.984696:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832922.988542:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832922.988958:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975455104 00000100:00100000:2.0:1788832922.988974:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975455104 00000100:00100000:2.0:1788832922.989038:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 53 00000100:00100000:2.0:1788832922.989047:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+34:11595:x1875726975455104:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:2.0:1788832922.989350:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+35:11595:x1875726975455104:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 300us (819us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788832922.989357:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 53 00000100:00100000:3.0:1788832923.092582:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832923.092666:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975455360 00000100:00100000:2.0:1788832923.092680:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975455360 00000100:00080000:1.0:1788832923.093004:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832923.093687:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 197 00000100:00100000:2.0:1788832923.093715:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+35:11606:x1875726975455360:12345-192.168.206.41@tcp:101:cat.0 00010000:00010000:2.0:1788832923.093820:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832923.093851:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5853 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b556f2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.093945:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a585a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.093979:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a585a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.093993:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a585a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094011:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5861 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094018:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094024:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094369:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094380:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094388:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832923.094398:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788832923.094523:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a585a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094531:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a585a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094538:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a585a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094551:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832923.094556:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a585a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094564:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a585a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094579:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832923.094582:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832923.094588:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a585a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094594:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a585a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094608:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094614:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5861 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094620:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094625:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832923.094628:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094634:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5861 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094653:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d0c2cf100) 00010000:00010000:2.0:1788832923.094655:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832923.094658:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5861 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094664:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5861 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094715:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5853 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556f2 expref: 38 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094731:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556f2 expref: 37 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.094740:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d02d42400) 00010000:00010000:2.0:1788832923.094802:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832923.094805:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703000, rc 0) 00000100:00100000:2.0:1788832923.094900:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+37:11606:x1875726975455360:12345-192.168.206.41@tcp:101:cat.0 Request processed in 1197us (2330us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788832923.094909:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 197 00000100:00100000:3.0:1788832923.101398:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832923.102051:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975455616 00000100:00100000:2.0:1788832923.102065:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975455616 00000100:00100000:2.0:1788832923.102144:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 54 00000100:00100000:2.0:1788832923.102157:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+37:11606:x1875726975455616:12345-192.168.206.41@tcp:35:cat.0 00000100:00100000:2.0:1788832923.102779:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+38:11606:x1875726975455616:12345-192.168.206.41@tcp:35:cat.0 Request processed in 590us (1359us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788832923.102789:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 54 00000100:00100000:3.0:1788832923.131939:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832923.132552:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975455872 00000100:00100000:0.0:1788832923.132567:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975455872 00000100:00100000:0.0:1788832923.132653:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 198 00000100:00100000:0.0:1788832923.132666:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+38:11607:x1875726975455872:12345-192.168.206.41@tcp:36:rm.0 00010000:00010000:0.0:1788832923.132837:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788832923.132873:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5868 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556f2 expref: 38 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.132901:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a583e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556eb expref: 37 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.132915:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5806 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556dd expref: 36 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.132927:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d02d42400) 00010000:00010000:0.0:1788832923.132960:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832923.132990:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5876 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.133005:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5876 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.133017:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5876 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.133034:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a587d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.133042:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a587d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.133049:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a587d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.134287:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5884 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.134322:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5884 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.134333:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5884 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788832923.135715:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1788832923.135731:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 426825986398ns, next at 427825982039ns, rc = 0 00010000:00010000:0.0:1788832923.135927:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a588b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.135956:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a588b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.135968:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a588b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.135978:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a588b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.135985:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a588b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.135991:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a588b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136016:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788832923.136042:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5884 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136050:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5884 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136056:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5884 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136063:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832923.136068:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5884 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136077:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5884 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136102:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d03c60400) 00010000:00010000:0.0:1788832923.136105:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788832923.136111:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5884 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136117:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5884 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136140:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5876 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136146:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5876 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136152:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5876 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136157:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832923.136160:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5876 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136166:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5876 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136174:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:0.0:1788832923.136176:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832923.136180:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5876 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.136185:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5876 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832923.136208:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ba65e89 reply state 000000003ef5f245 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a587d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832923.136218:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788832923.136724:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832923.136734:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a588b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.136773:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bbc00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788832923.136778:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a588b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.136786:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a588b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.136797:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff984d03c60400) 00010000:00010000:2.0:1788832923.136800:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788832923.136804:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a588b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.136809:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a588b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.136830:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832923.136832:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832923.136834:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832923.137210:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+37:11607:x1875726975455872:12345-192.168.206.41@tcp:36:rm.0 Request processed in 4538us (5277us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788832923.137222:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 198 00010000:00010000:0.0:1788832923.141334:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a587d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.141356:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a587d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.141365:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a587d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.141372:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832923.141377:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a587d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.141386:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a587d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.141406:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d03c60300) 00010000:00010000:0.0:1788832923.141420:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832923.141425:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a587d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.141432:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a587d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832923.187571:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832923.187971:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975456128 00000100:00100000:0.0:1788832923.187985:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975456128 00000100:00100000:0.0:1788832923.188075:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 199 00000100:00100000:0.0:1788832923.188087:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+36:11613:x1875726975456128:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:0.0:1788832923.188121:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832923.188149:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5892 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b556f9 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.188301:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5899 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.188485:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5899 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.188507:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5899 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.188527:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a58a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.188535:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a58a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.188542:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a58a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788832923.190308:0:7174:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788832923.190613:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a58a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.190634:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a58a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.190647:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a58a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.190694:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5899 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.190703:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5899 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.190709:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5899 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.190715:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832923.190720:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5899 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.190728:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5899 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.190923:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:1.0:1788832923.190927:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832923.190933:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5899 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.190939:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5899 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832923.190955:0:7174:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000156f9aca reply state 00000000fb651143 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a58a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832923.190966:0:7174:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788832923.191037:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5892 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556f9 expref: 39 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.191053:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a58a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556f9 expref: 38 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.191062:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42200) 00010000:00010000:1.0:1788832923.191064:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832923.191067:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05e00, rc 0) 00000100:00100000:1.0:1788832923.191382:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+39:11613:x1875726975456128:12345-192.168.206.41@tcp:101:bash.0 Request processed in 3296us (3824us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788832923.191392:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 199 00010000:00010000:1.0:1788832923.194908:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a58a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.194932:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a58a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.194963:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a58a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.194970:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832923.194975:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a58a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.194985:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a58a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.195007:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d03c60300) 00010000:00010000:1.0:1788832923.195010:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832923.195016:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a58a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.195023:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a58a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832923.196069:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832923.196382:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975456256 00000100:00100000:1.0:1788832923.196396:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975456256 00000100:00100000:1.0:1788832923.196568:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 59 00000100:00100000:1.0:1788832923.196580:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2359:x1875726975456256:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:1.0:1788832923.196599:0:8475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832923.196622:0:8475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a58b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55700 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788832923.196647:0:8475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788832923.196665:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1788832923.196682:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832923.196691:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a58b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55700 expref: 6 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.196710:0:8475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a58b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55700 expref: 6 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.196723:0:8475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05400, rc 0) 00000100:00100000:1.0:1788832923.196819:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2359:x1875726975456256:12345-192.168.206.41@tcp:101:bash.0 Request processed in 240us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832923.196826:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 59 00000100:00100000:0.0:1788832923.200044:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832923.200204:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975456384 00000100:00100000:2.0:1788832923.200217:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975456384 00000100:00100000:2.0:1788832923.200292:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 60 00000100:00100000:2.0:1788832923.200304:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:11613:x1875726975456384:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:2.0:1788832923.200327:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832923.200350:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55707 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.200389:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a58b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55700 expref: 7 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.200430:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832923.200435:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832923.200442:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.200497:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a58b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55700 expref: 7 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.200513:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a58b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55700 expref: 7 pid: 8475 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832923.200529:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aba5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1875726994320128:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832923.200650:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832923.203141:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aba5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1875726994320128:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832923.203189:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.203213:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703400, rc 0) 00000100:00100000:1.0:1788832923.203285:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:11613:x1875726975456384:12345-192.168.206.41@tcp:101:bash.0 Request processed in 2983us (3255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832923.203295:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 60 00000100:00100000:0.0:1788832923.204989:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832923.205119:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975456512 00000100:00100000:1.0:1788832923.205132:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975456512 00010000:00010000:1.0:1788832923.205178:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a58b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55700 expref: 7 pid: 8475 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832923.205229:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 76 00000100:00100000:1.0:1788832923.205239:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975456512:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832923.205275:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832923.205304:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a58b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55700 expref: 7 pid: 8475 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.205320:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a58b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55700 expref: 7 pid: 8475 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.205348:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca515ae/0xd270a10c1c6a58b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55700 expref: 7 pid: 8475 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.205369:0:7639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832923.205373:0:7639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832923.205383:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.205393:0:7639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.205573:0:7639:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832923.205592:0:7639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7639:1875726994320256:192.168.206.41@tcp:105: 00000100:00100000:1.0:1788832923.205696:0:7639:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c07b8c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788832923.208901:0:7639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7639:1875726994320256:192.168.206.41@tcp:105: 00000100:00100000:0.0:1788832923.208920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00010000:00010000:1.0:1788832923.208940:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832923.209010:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975456512:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 3771us (4032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832923.209022:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 76 00000100:00100000:3.0:1788832923.209219:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975456768 00000100:00100000:3.0:1788832923.209234:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975456768 00000100:00100000:3.0:1788832923.209567:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 55 00000100:00100000:3.0:1788832923.209579:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+38:11613:x1875726975456768:12345-192.168.206.41@tcp:35:bash.0 00000100:00100000:3.0:1788832923.210059:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+39:11613:x1875726975456768:12345-192.168.206.41@tcp:35:bash.0 Request processed in 475us (1131us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788832923.210069:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 55 00010000:00010000:0.0:1788832923.222233:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832923.374829:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832923.374939:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975456896 00000100:00100000:0.0:1788832923.374953:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975456896 00000100:00100000:0.0:1788832923.375038:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 200 00000100:00100000:0.0:1788832923.375049:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+39:11629:x1875726975456896:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788832923.375093:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832923.375123:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a58c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5570e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.375266:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a58ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.375283:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a58ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.375299:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a58ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832923.375344:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788832923.375348:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788832923.375367:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a58ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.375396:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a58c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5570e expref: 41 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.375415:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a58ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5570e expref: 40 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.375424:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:0.0:1788832923.376889:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832923.376897:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036baa00, rc 0) 00000100:00100000:0.0:1788832923.376986:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+40:11629:x1875726975456896:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 1934us (2174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832923.376997:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 200 00000100:00100000:0.0:1788832923.382426:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832923.382548:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975457152 00000100:00100000:2.0:1788832923.382562:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975457152 00000100:00100000:2.0:1788832923.382634:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 201 00000100:00100000:2.0:1788832923.382647:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+40:11629:x1875726975457152:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832923.382677:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832923.382708:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a58d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55715 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.382882:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a58d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.382917:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a58d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.382931:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a58d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832923.382946:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788832923.383139:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a58d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55715 expref: 43 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.383163:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a58d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55715 expref: 42 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.383174:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42200) 00010000:00010000:2.0:1788832923.383178:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832923.383183:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702600, rc 0) 00000100:00100000:2.0:1788832923.383272:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+42:11629:x1875726975457152:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 627us (864us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788832923.383280:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 201 00000100:00100000:1.0:1788832923.388924:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832923.388977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832923.389079:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975457536 00000100:00100000:0.0:1788832923.389092:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975457536 00000100:00100000:0.0:1788832923.389162:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 202 00000100:00100000:0.0:1788832923.389174:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+42:11629:x1875726975457536:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788832923.389204:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832923.389230:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a58e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5571c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.389357:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a58ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.389377:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a58ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.389393:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a58ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832923.389414:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788832923.389589:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a58e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5571c expref: 45 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.389614:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a58ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5571c expref: 44 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.389651:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42200) 00010000:00010000:0.0:1788832923.389655:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788832923.389660:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bbe00, rc 0) 00000100:00100000:0.0:1788832923.389801:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+44:11629:x1875726975457536:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 629us (822us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788832923.389809:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 202 00000100:00100000:3.0:1788832923.389941:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975457280 00000100:00100000:3.0:1788832923.389949:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975457280 00000100:00100000:3.0:1788832923.390001:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:3.0:1788832923.390010:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+44:2357:x1875726975457280:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832923.390022:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832923.390043:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702600/0xd270a10c1c6a58d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55715 expref: 44 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.390056:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42200) 00010000:00010000:3.0:1788832923.390059:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832923.390084:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+43:2357:x1875726975457280:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 75us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832923.390091:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:0.0:1788832923.397040:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832923.397153:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975457664 00000100:00100000:2.0:1788832923.397166:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975457664 00000100:00100000:2.0:1788832923.397245:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 61 00000100:00100000:2.0:1788832923.397257:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+6:2358:x1875726975457664:12345-192.168.206.41@tcp:1:lfs.0 00010000:00010000:2.0:1788832923.397317:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.397344:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.397373:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788832923.397378:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832923.397384:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.398700:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.398727:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 6 pid: 6699 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832923.398778:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875726994320384:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832923.398920:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832923.402149:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832923.402429:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975457792 00000100:00100000:3.0:1788832923.402441:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975457792 00002000:00100000:3.0:1788832923.402513:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff984d3b92ed80 x1875726975457792/t0(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:109/0 lens 504/0 e 0 to 0 dl 1788832934 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788832923.402525:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3b92ed80 with x1875726975457792 ext(0->8) 00010000:00010000:3.0:1788832923.402536:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 7 pid: 6699 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.402580:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 7 pid: 6699 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832923.402589:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff984d3b92ed80 00000100:00100000:3.0:1788832923.402633:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 3 00000100:00100000:3.0:1788832923.402644:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975457792:12345-192.168.206.41@tcp:4:lfs.0 00000100:00100000:3.0:1788832923.403512:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2357:x1875726975457792:12345-192.168.206.41@tcp:4:lfs.0 Request processed in 861us (1368us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788832923.403522:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 3 00002000:00100000:3.0:1788832923.403532:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff984d3b92ed80 x1875726975457792/t4294967308(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:109/0 lens 504/448 e 0 to 0 dl 1788832934 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788832923.403543:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3b92ed80 with x1875726975457792 ext(0->8) 00010000:00010000:3.0:1788832923.403551:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 9 pid: 6699 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.403567:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 9 pid: 6699 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832923.403576:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff984d3b92ed80 00000100:00100000:2.0:1788832923.403914:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875726994320384:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832923.403955:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832923.422174:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832923.422265:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975457920 00000100:00100000:3.0:1788832923.422279:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975457920 00010000:00010000:3.0:1788832923.422327:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 9 pid: 6699 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832923.422414:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 77 00000100:00100000:3.0:1788832923.422426:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2357:x1875726975457920:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832923.422444:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788832923.422469:0:5840:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788832923.422472:0:5840:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788832923 00002000:00010000:3.0:1788832923.422475:0:5840:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788832923 00002000:00010000:3.0:1788832923.422477:0:5840:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788832923 00010000:00010000:3.0:1788832923.422484:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 9 pid: 6699 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.422512:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 9 pid: 6699 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.422543:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc4885e0/0xd270a10c1c6a58bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55707 expref: 9 pid: 6699 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.422563:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832923.422568:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832923.422576:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.422588:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.422625:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832923.422725:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.422736:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.422853:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.422870:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.422879:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.422887:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788832923.422892:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.422902:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.422916:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.422925:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb652bde/0xd270a10c1c6a58fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832923.436505:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2357:x1875726975457920:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 14052us (14318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832923.436524:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 77 00000100:00100000:2.0:1788832923.436708:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975457664:12345-192.168.206.41@tcp:1:lfs.0 Request processed in 39450us (39680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832923.436719:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 61 00000100:00100000:2.0:1788832923.445685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832923.446017:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975458176 00000100:00100000:1.0:1788832923.446031:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975458176 00000100:00100000:1.0:1788832923.446106:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 56 00000100:00100000:1.0:1788832923.446117:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d033dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+43:11629:x1875726975458176:12345-192.168.206.41@tcp:35:lfs.0 00000004:00010000:1.0:1788832923.446200:0:5857:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a58ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5571c expref: 43 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788832923.447221:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788832923.447277:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788832923.449163:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788832923.449273:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.449297:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a58a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556f9 expref: 47 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.449307:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.449353:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a58a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556f9 expref: 47 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.449373:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a58a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556f9 expref: 47 pid: 7174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832923.450528:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5857:1875726994320512:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832923.450687:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c07b8c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788832923.455139:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5857:1875726994320512:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832923.455201:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832923.458420:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832923.458816:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975458304 00000100:00100000:1.0:1788832923.458829:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975458304 00010000:00010000:1.0:1788832923.458882:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a58a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556f9 expref: 48 pid: 7174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832923.458932:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 78 00000100:00100000:1.0:1788832923.458951:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+48:2357:x1875726975458304:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832923.458970:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832923.458979:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a58a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556f9 expref: 48 pid: 7174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.458995:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a58a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556f9 expref: 48 pid: 7174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.459023:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a58a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556f9 expref: 48 pid: 7174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.459041:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42200) 00010000:00010000:1.0:1788832923.459047:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.459057:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.459087:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.459123:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832923.459156:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.459163:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832923.459197:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+47:2357:x1875726975458304:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 248us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832923.459205:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 78 00000001:00080000:2.0:1788832923.459323:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788832923.459581:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788832923.459705:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aba5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1875726994320640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788832923.459825:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832923.459856:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994320640 00000100:00100000:2.0:1788832923.459862:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832923.459864:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994320640 00000100:00100000:1.0:1788832923.459908:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832923.459917:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5857:x1875726994320640:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788832923.461993:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5857:x1875726994320640:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 2066us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832923.462007:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788832923.464151:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aba5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1875726994320640:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788832923.464793:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788832923.464895:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b366a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1875726994320768:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788832923.465053:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832923.465091:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832923.465224:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994320768 00000100:00100000:0.0:1788832923.465234:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994320768 00000100:00100000:0.0:1788832923.465293:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788832923.465303:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5857:x1875726994320768:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788832923.465543:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5857:x1875726994320768:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 241us (489us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788832923.465552:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788832923.465734:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b366a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1875726994320768:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788832923.465832:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788832923.465879:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.465890:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.465898:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.465915:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832923.465920:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.466036:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.466057:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42200) 00010000:00010000:2.0:1788832923.466060:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788832923.466066:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.466073:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5902 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788832923.466289:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788832923.466412:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788832923.466425:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 427156680870ns, next at 428156678012ns, rc = 0 00000001:00080000:2.0:1788832923.466432:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788832923.466469:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42200) 00010000:00010000:2.0:1788832923.466472:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788832923.466480:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a58ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5571c expref: 51 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832923.466620:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d033dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+50:11629:x1875726975458176:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 20504us (20949us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788832923.466630:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 56 00000020:00080000:2.0:1788832923.466636:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788832923.469505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832923.469605:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975458432 00000100:00100000:1.0:1788832923.469617:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975458432 00000100:00100000:1.0:1788832923.469691:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 203 00000100:00100000:1.0:1788832923.469704:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+50:11629:x1875726975458432:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832923.469737:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832923.469789:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5909 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55723 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.469867:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5909 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55723 expref: 51 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.469885:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5909 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55723 expref: 51 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.469942:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:1.0:1788832923.469946:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832923.469951:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05200, rc 0) 00000100:00100000:1.0:1788832923.470022:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+51:11629:x1875726975458432:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 321us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832923.470030:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 203 00000100:00100000:1.0:1788832923.475344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832923.475442:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975458688 00000100:00100000:3.0:1788832923.475454:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975458688 00000100:00100000:3.0:1788832923.475531:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 57 00000100:00100000:3.0:1788832923.475543:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+51:11629:x1875726975458688:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:3.0:1788832923.475873:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:11629:x1875726975458688:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 331us (542us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788832923.475882:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 57 00000100:00100000:3.0:1788832923.565211:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832923.565350:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975458816 00000100:00100000:0.0:1788832923.565364:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975458816 00000100:00100000:0.0:1788832923.565452:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 204 00000100:00100000:0.0:1788832923.565464:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:11639:x1875726975458816:12345-192.168.206.41@tcp:34:lfs.0 00010000:00010000:0.0:1788832923.565576:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5910 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.565596:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5910 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.565611:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5910 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.565647:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a5917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.565656:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a5917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.565663:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a5917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.565946:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a591e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.565956:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a591e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.565963:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a591e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832923.566029:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a591e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566044:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5910 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566052:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5910 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566059:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5910 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566066:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832923.566071:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5910 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566087:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5910 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566102:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:0.0:1788832923.566106:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832923.566112:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5910 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566118:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5910 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566134:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a5917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566140:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a5917 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566146:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a5917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566152:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bbe00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832923.566155:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a5917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566162:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a5917 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566170:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d03c60700) 00010000:00010000:0.0:1788832923.566173:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832923.566176:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a5917 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566193:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a5917 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566212:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a591e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566218:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a591e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566224:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a591e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566228:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bac00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832923.566232:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a591e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566238:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a591e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566247:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:0.0:1788832923.566249:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832923.566252:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a591e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.566258:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a591e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832923.566620:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:11639:x1875726975458816:12345-192.168.206.41@tcp:34:lfs.0 Request processed in 1153us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832923.566631:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 204 00000100:00100000:0.0:1788832923.613653:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832923.613727:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975459072 00000100:00100000:1.0:1788832923.613740:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975459072 00000100:00100000:1.0:1788832923.613854:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 205 00000100:00100000:1.0:1788832923.613865:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+52:11642:x1875726975459072:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832923.613891:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832923.613918:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5925 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5572a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614025:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a592c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614042:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a592c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614055:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a592c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614072:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5933 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614079:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614104:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614255:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a593a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614264:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a593a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614272:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a593a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832923.614282:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788832923.614408:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a592c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614416:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a592c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614424:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a592c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614430:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832923.614435:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a592c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614443:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a592c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614457:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:1.0:1788832923.614460:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832923.614473:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a592c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614480:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05e00/0xd270a10c1c6a592c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614507:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614514:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5933 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614519:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614524:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832923.614527:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614534:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5933 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614543:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d02d42e00) 00010000:00010000:1.0:1788832923.614546:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832923.614549:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5933 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614555:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05600/0xd270a10c1c6a5933 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614599:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05400/0xd270a10c1c6a5925 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5572a expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614624:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a593a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5572a expref: 54 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.614632:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:1.0:1788832923.614634:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832923.614637:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04a00, rc 0) 00000100:00100000:1.0:1788832923.614713:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:11642:x1875726975459072:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 850us (1074us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788832923.614725:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 205 00000100:00100000:1.0:1788832923.618080:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832923.618185:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975459200 00000100:00100000:2.0:1788832923.618197:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975459200 00000100:00100000:2.0:1788832923.618318:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 206 00000100:00100000:2.0:1788832923.618332:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:11642:x1875726975459200:12345-192.168.206.41@tcp:54:lfs.0 00010000:00010000:2.0:1788832923.618434:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.618455:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.618469:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.618514:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.618522:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5948 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.618530:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.618536:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832923.618541:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.618549:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5948 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.618563:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:2.0:1788832923.618566:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832923.618590:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5948 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.618597:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a5948 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832923.618696:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:11642:x1875726975459200:12345-192.168.206.41@tcp:54:lfs.0 Request processed in 366us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832923.618705:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 206 00000100:00100000:3.0:1788832923.620801:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832923.621138:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975459456 00000100:00100000:1.0:1788832923.621150:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975459456 00000100:00100000:1.0:1788832923.621218:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 58 00000100:00100000:1.0:1788832923.621229:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+54:11642:x1875726975459456:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:1.0:1788832923.621561:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:11642:x1875726975459456:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 332us (770us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788832923.621570:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 58 00000100:00100000:1.0:1788832923.700913:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832923.701115:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975459712 00000100:00100000:2.0:1788832923.701129:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975459712 00000100:00100000:2.0:1788832923.701204:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 207 00000100:00100000:2.0:1788832923.701215:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:11652:x1875726975459712:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:2.0:1788832923.701245:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832923.701249:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788832923.701282:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a58ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5570e expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.701309:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832923.701316:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832923.701333:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a594f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55731 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.701499:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.701515:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a593a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5572a expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.701525:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.701580:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a593a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5572a expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.701595:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a593a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5572a expref: 55 pid: 5855 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832923.701612:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b367800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994320896:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832923.701803:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788832923.704596:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832923.705092:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975459840 00000100:00100000:2.0:1788832923.705105:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975459840 00010000:00010000:2.0:1788832923.705163:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a593a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5572a expref: 56 pid: 5855 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832923.705204:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 79 00000100:00100000:2.0:1788832923.705215:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+56:2358:x1875726975459840:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832923.705235:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832923.705243:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a593a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5572a expref: 56 pid: 5855 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.705258:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a593a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5572a expref: 56 pid: 5855 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.705286:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:2.0:1788832923.705293:0:7639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.705371:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.705381:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.705571:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04a00/0xd270a10c1c6a593a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5572a expref: 56 pid: 5855 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832923.705594:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b367800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994320896:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832923.705621:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.705633:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.705639:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832923.705662:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788832923.705836:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832923.705907:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:2358:x1875726975459840:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 692us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832923.705916:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 79 00010000:00010000:3.0:1788832923.706661:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703800/0xd270a10c1c6a594f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55731 expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.706697:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55731 expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.706707:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:3.0:1788832923.706711:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832923.706714:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703400, rc 0) 00000100:00100000:3.0:1788832923.707829:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:11652:x1875726975459712:12345-192.168.206.41@tcp:101:bash.0 Request processed in 6605us (6920us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788832923.707842:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 207 00000100:00100000:1.0:1788832923.711623:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832923.711730:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975460096 00000100:00100000:0.0:1788832923.711992:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975460096 00000100:00100000:0.0:1788832923.712102:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 208 00000100:00100000:0.0:1788832923.712114:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+55:11652:x1875726975460096:12345-192.168.206.41@tcp:36:bash.0 00010000:00010000:0.0:1788832923.712494:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a5964 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.712515:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a5964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.712530:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a5964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788832923.712592:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788832923.712626:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ebc94e4 reply state 00000000d9cdc976 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a5964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832923.712636:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788832923.712842:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+58:11652:x1875726975460096:12345-192.168.206.41@tcp:36:bash.0 Request processed in 730us (1232us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788832923.712850:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 208 00000020:00080000:0.0:1788832923.712857:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788832923.718596:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832923.718640:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975460224 00000100:00100000:1.0:1788832923.718653:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975460224 00000100:00100000:1.0:1788832923.718714:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 209 00000100:00100000:1.0:1788832923.718726:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+58:11652:x1875726975460224:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:2.0:1788832923.718884:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a5964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.718897:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a5964 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.718906:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a5964 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.718913:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bac00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832923.718918:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a5964 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.718927:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a5964 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.719016:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:2.0:1788832923.719020:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832923.719027:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a5964 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.719054:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a5964 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.720343:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832923.720384:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9200/0xd270a10c1c6a596b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55738 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.720510:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.720530:0:7174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55731 expref: 58 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.720540:0:7174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.720583:0:7174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55731 expref: 58 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.720602:0:7174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55731 expref: 58 pid: 5855 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832923.720617:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994321024:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832923.721128:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c07b8cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832923.724529:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832923.724620:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975460352 00000100:00100000:3.0:1788832923.724632:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975460352 00010000:00010000:3.0:1788832923.724685:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55731 expref: 59 pid: 5855 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832923.724800:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 80 00000100:00100000:3.0:1788832923.724812:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:2358:x1875726975460352:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832923.724832:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832923.724840:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55731 expref: 59 pid: 5855 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.724855:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55731 expref: 59 pid: 5855 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.724882:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:3.0:1788832923.724888:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.724914:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.724923:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.725051:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832923.725114:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:2358:x1875726975460352:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 303us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832923.725123:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 80 00010000:00010000:2.0:1788832923.725556:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5956 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55731 expref: 58 pid: 5855 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832923.725577:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994321024:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832923.725605:0:7174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.725614:0:7174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.725620:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832923.725678:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788832923.725683:0:7174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788832923.725708:0:7174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.725773:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9200/0xd270a10c1c6a596b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55738 expref: 58 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.725792:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55738 expref: 57 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.725799:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:2.0:1788832923.725802:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832923.725820:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d9c00, rc 0) 00000100:00100000:2.0:1788832923.725868:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:11652:x1875726975460224:12345-192.168.206.41@tcp:101:bash.0 Request processed in 7144us (7285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832923.725877:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 209 00000100:00100000:1.0:1788832923.730065:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832923.730263:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975460608 00000100:00100000:3.0:1788832923.730277:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975460608 00000100:00100000:3.0:1788832923.730657:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 59 00000100:00100000:3.0:1788832923.730671:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+57:11652:x1875726975460608:12345-192.168.206.41@tcp:35:bash.0 00000100:00100000:3.0:1788832923.731334:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+58:11652:x1875726975460608:12345-192.168.206.41@tcp:35:bash.0 Request processed in 662us (1279us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788832923.731345:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 59 00000100:00100000:0.0:1788832923.785685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832923.786046:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975460736 00000100:00100000:2.0:1788832923.786060:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975460736 00000100:00100000:2.0:1788832923.786171:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 210 00000100:00100000:2.0:1788832923.786183:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+58:11658:x1875726975460736:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832923.786219:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832923.786247:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5979 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5573f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.786343:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5980 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.786361:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.786374:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832923.786434:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788832923.786438:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788832923.786461:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.786501:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5979 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5573f expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.786524:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5573f expref: 59 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.786553:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832923.786557:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832923.786561:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702c00, rc 0) 00000100:00100000:2.0:1788832923.786649:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:11658:x1875726975460736:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 468us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832923.786658:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 210 00000100:00100000:0.0:1788832923.792707:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832923.792869:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975460864 00000100:00100000:2.0:1788832923.792883:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975460864 00000100:00100000:2.0:1788832923.792973:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 211 00000100:00100000:2.0:1788832923.792985:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:11658:x1875726975460864:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832923.793012:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832923.793038:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5987 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55746 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793124:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a598e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793140:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a598e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793153:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a598e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793169:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793176:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793203:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793325:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a599c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793335:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a599c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793342:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a599c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832923.793385:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788832923.793390:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788832923.793426:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a599c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793440:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a599c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793449:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a598e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793455:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a598e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793462:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a598e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793468:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832923.793473:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a598e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793498:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a598e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793513:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832923.793516:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832923.793522:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a598e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793528:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a598e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793543:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793549:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5995 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793555:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793561:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832923.793564:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793569:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5995 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793578:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d0c2cf100) 00010000:00010000:2.0:1788832923.793581:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832923.793583:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5995 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793599:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793636:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a5987 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55746 expref: 61 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793651:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a599c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55746 expref: 60 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.793659:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:2.0:1788832923.793661:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832923.793664:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703000, rc 0) 00000100:00100000:2.0:1788832923.793816:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+60:11658:x1875726975460864:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 832us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832923.793824:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 211 00000100:00100000:1.0:1788832923.800195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832923.800311:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832923.800419:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975461248 00000100:00100000:3.0:1788832923.800433:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975461248 00000100:00100000:3.0:1788832923.800528:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:3.0:1788832923.800540:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+60:2358:x1875726975461248:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832923.800563:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832923.800596:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a599c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55746 expref: 60 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.800623:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:3.0:1788832923.800648:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832923.800775:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:2358:x1875726975461248:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 206us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832923.800784:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:0.0:1788832923.802261:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975461120 00000100:00100000:0.0:1788832923.802282:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975461120 00000100:00100000:0.0:1788832923.802394:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 212 00000100:00100000:0.0:1788832923.802416:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:11658:x1875726975461120:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788832923.802443:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832923.802481:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a59a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5574d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.802653:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.802682:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55738 expref: 60 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.802693:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.802834:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55738 expref: 60 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832923.802852:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55738 expref: 60 pid: 7174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832923.802868:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994321152:192.168.206.41@tcp:104: 00000100:00100000:0.0:1788832923.803180:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d92300 going to sleep for 11 seconds 00000100:00100000:1.0:1788832923.816715:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832923.816969:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975461376 00000100:00100000:3.0:1788832923.816981:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975461376 00010000:00010000:3.0:1788832923.817034:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55738 expref: 61 pid: 7174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832923.817086:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 81 00000100:00100000:3.0:1788832923.817097:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:2357:x1875726975461376:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832923.817113:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832923.817121:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55738 expref: 61 pid: 7174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.817137:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55738 expref: 61 pid: 7174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.817165:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:3.0:1788832923.817170:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.817181:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.817189:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.817211:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832923.817290:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:2357:x1875726975461376:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 194us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832923.817300:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 81 00010000:00010000:2.0:1788832923.817629:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5972 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55738 expref: 60 pid: 7174 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832923.817650:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994321152:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832923.817688:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.817699:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.817704:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832923.817738:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788832923.818128:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a59a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5574d expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.818147:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5574d expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.818156:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:2.0:1788832923.818159:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788832923.818162:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bba00, rc 0) 00000100:00100000:2.0:1788832923.818200:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+60:11658:x1875726975461120:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 15798us (18018us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788832923.818209:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 212 00000100:00100000:1.0:1788832923.829039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832923.829215:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975461632 00000100:00100000:3.0:1788832923.829228:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975461632 00000100:00100000:3.0:1788832923.829306:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 17 00000100:00100000:3.0:1788832923.829318:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+60:11658:x1875726975461632:12345-192.168.206.41@tcp:103:lfs.0 00010000:00010000:3.0:1788832923.829337:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832923.829368:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a5909 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55723 expref: 60 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832923.829392:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:3.0:1788832923.829397:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832923.829468:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:11658:x1875726975461632:12345-192.168.206.41@tcp:103:lfs.0 Request processed in 153us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832923.829477:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 17 00000100:00100000:3.0:1788832923.838135:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832923.838323:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975461760 00000100:00100000:1.0:1788832923.838336:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975461760 00000100:00100000:1.0:1788832923.838414:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 213 00000100:00100000:1.0:1788832923.838445:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:11658:x1875726975461760:12345-192.168.206.41@tcp:58:lfs.0 00010000:00010000:1.0:1788832923.838589:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a59b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.838610:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a59b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832923.838624:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a59b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788832923.839174:0:7174:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788832923.839330:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:11658:x1875726975461760:12345-192.168.206.41@tcp:58:lfs.0 Request processed in 885us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832923.839341:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 213 00000100:00100000:1.0:1788832923.851153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832923.852000:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975461888 00000100:00100000:2.0:1788832923.852018:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975461888 00000100:00100000:2.0:1788832923.852154:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 214 00000100:00100000:2.0:1788832923.852168:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+59:11658:x1875726975461888:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788832923.852195:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832923.852223:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a59bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55754 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.852307:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a59b8 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.852321:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a59bf lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55754 expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.852375:0:5854:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a59b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.852391:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a59bf lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55754 expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.852417:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:2.0:1788832923.852420:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788832923.852425:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a59bf lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55754 expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832923.852434:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703400, rc 0) 00000100:00100000:2.0:1788832923.852526:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+60:11658:x1875726975461888:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 361us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832923.852534:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 214 00010000:00010000:0.0:1788832924.252617:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788832924.310548:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832924.310557:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832924.310626:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788832924.310633:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832924.310812:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7f1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875726994321408:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832924.311102:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d92300 going to sleep for 11 seconds 00000100:00100000:2.0:1788832924.311184:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832924.311200:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994321280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832924.311258:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832924.311358:0:11720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994321280 00000100:00100000:0.0:1788832924.311367:0:11720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994321280 00000100:00100000:0.0:1788832924.311450:0:11720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788832924.311461:0:11720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875726994321280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832924.311496:0:11720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832924.311556:0:11720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875726994321280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832924.311563:0:11720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788832924.311620:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994321280:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788832924.312790:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832924.315934:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.316169:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975462016 00000100:00100000:2.0:1788832924.316183:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975462016 00000100:00100000:2.0:1788832924.316263:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 215 00000100:00100000:2.0:1788832924.316273:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:11659:x1875726975462016:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788832924.316340:0:5855:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788832924.316490:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:11659:x1875726975462016:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 Request processed in 208us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832924.316510:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 215 00000100:00100000:0.0:1788832924.317306:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7f1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875726994321408:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788832924.322793:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832924.324238:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975462144 00000100:00100000:0.0:1788832924.324258:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975462144 00000100:00100000:0.0:1788832924.324365:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 216 00000100:00100000:0.0:1788832924.324378:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+60:11659:x1875726975462144:12345-192.168.206.41@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788832924.324494:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a59c6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.324515:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a59c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.324533:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a59c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.324551:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a59cd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.324557:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a59cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.324565:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a59cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.324612:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a59d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.324623:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a59d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.324630:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a59d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832924.324680:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788832924.324684:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788832924.324701:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a59d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.324713:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a59c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.324720:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a59c6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.324727:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a59c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.324733:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba400 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832924.324738:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a59c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.324919:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a59c6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325129:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d02d42000) 00010000:00010000:0.0:1788832924.325139:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832924.325146:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a59c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325152:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a59c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325168:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a59cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325174:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a59cd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325180:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a59cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325186:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832924.325189:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a59cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325195:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a59cd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325203:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff984d03c60700) 00010000:00010000:0.0:1788832924.325205:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832924.325208:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a59cd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325214:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a59cd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325231:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a59d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325243:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a59d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325249:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a59d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325255:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832924.325258:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a59d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325264:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a59d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325273:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:0.0:1788832924.325275:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832924.325278:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a59d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.325283:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a59d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832924.326509:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+60:11659:x1875726975462144:12345-192.168.206.41@tcp:34:lhsmtool_posix.0 Request processed in 2104us (3738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832924.326525:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 216 00000100:00100000:3.0:1788832924.330633:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.330933:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975462400 00000100:00100000:2.0:1788832924.330947:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975462400 00000100:00100000:2.0:1788832924.331026:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 217 00000100:00100000:2.0:1788832924.331038:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+60:11659:x1875726975462400:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832924.331065:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832924.331092:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a59db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5575b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.331221:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a59e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.331241:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a59e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.331255:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a59e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832924.331272:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788832924.331418:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a59e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.331427:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a59e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.331435:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a59e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.331442:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832924.331447:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a59e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.331475:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a59e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.331502:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:2.0:1788832924.331506:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788832924.331512:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a59e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.331519:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a59e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.331572:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a59db lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5575b expref: 62 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.331584:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d02d42000) 00010000:00010000:2.0:1788832924.331587:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832924.331591:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a59db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5575b expref: 62 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.331601:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703600, rc 0) 00000100:00100000:2.0:1788832924.331682:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:11659:x1875726975462400:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 646us (1065us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788832924.331690:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 217 00000100:00100000:1.0:1788832924.338097:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.338202:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975462528 00000100:00100000:2.0:1788832924.338215:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975462528 00000100:00100000:2.0:1788832924.338333:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 218 00000100:00100000:2.0:1788832924.338345:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:11659:x1875726975462528:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788832924.338417:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788832924.338561:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:11659:x1875726975462528:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 Request processed in 216us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832924.338568:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 218 00000100:00100000:1.0:1788832924.341991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832924.343668:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975462784 00000100:00100000:0.0:1788832924.343836:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975462784 00000100:00100000:0.0:1788832924.344055:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 219 00000100:00100000:0.0:1788832924.344068:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:11659:x1875726975462784:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788832924.344095:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832924.344116:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788832924.344150:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702c00/0xd270a10c1c6a5980 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5573f expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.344171:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:0.0:1788832924.344176:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832924.344194:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a59f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55762 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788832924.345584:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788832924.346192:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9400/0xd270a10c1c6a59f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.346214:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9400/0xd270a10c1c6a59f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.346227:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9400/0xd270a10c1c6a59f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.346301:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a59f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55762 expref: 63 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.346336:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9400/0xd270a10c1c6a59f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55762 expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.346346:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff984d02d42e00) 00010000:00010000:1.0:1788832924.346349:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832924.346352:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d9400, rc 0) 00000100:00100000:1.0:1788832924.346508:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+62:11659:x1875726975462784:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 2442us (4530us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788832924.346517:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 219 00000100:00100000:1.0:1788832924.357571:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.358209:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975463040 00000100:00100000:2.0:1788832924.358223:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975463040 00000100:00100000:2.0:1788832924.358424:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 220 00000100:00100000:2.0:1788832924.358439:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+62:11659:x1875726975463040:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788832924.358536:0:7174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832924.358570:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9400/0xd270a10c1c6a59f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55762 expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.358595:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff984d02d42e00) 00010000:00010000:2.0:1788832924.358607:0:7174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832924.358636:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5a05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.358651:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5a05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.358662:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5a05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.358692:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xea904066 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.358700:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xea904066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.358729:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xea904066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359049:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5a05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359059:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5a05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359067:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5a05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359073:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832924.359078:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5a05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359087:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5a05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359097:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:2.0:1788832924.359100:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832924.359104:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5a05 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359111:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a5a05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359122:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xea904066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359128:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xea904066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359140:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xea904066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359146:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832924.359149:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xea904066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359156:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xea904066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359164:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xea904066 (ffff984d0c2cf100) 00010000:00010000:2.0:1788832924.359167:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832924.359170:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xea904066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.359175:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xea904066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832924.359410:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:11659:x1875726975463040:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 972us (1850us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788832924.359419:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 220 00000100:00100000:1.0:1788832924.363627:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832924.363709:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975463168 00000100:00100000:0.0:1788832924.363721:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975463168 00000100:00100000:0.0:1788832924.363821:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 221 00000100:00100000:0.0:1788832924.363833:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+61:11659:x1875726975463168:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788832924.363859:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832924.363891:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a5a13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55769 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.363951:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a5a1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.363967:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a5a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.363982:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a5a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.364107:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a5a13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55769 expref: 63 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.364128:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a5a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55769 expref: 62 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.364145:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff984d03c60700) 00010000:00010000:0.0:1788832924.364148:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788832924.364153:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036ba400, rc 0) 00000100:00100000:0.0:1788832924.365550:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+62:11659:x1875726975463168:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 1709us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832924.365563:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 221 00000100:00100000:1.0:1788832924.374509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.374630:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975463424 00000100:00100000:2.0:1788832924.374644:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975463424 00000100:00100000:2.0:1788832924.375130:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 222 00000100:00100000:2.0:1788832924.375145:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+62:11659:x1875726975463424:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788832924.375255:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.375277:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.375308:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788832924.375710:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1788832924.375723:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 428065978413ns, next at 429065975389ns, rc = 0 00000004:00010000:2.0:1788832924.376103:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae0bd23c reply state 00000000cd2229dc transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832924.376116:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832924.376318:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+64:11659:x1875726975463424:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 1175us (1821us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788832924.376328:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 222 00000100:00100000:1.0:1788832924.383812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832924.385131:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975463552 00000100:00100000:3.0:1788832924.385150:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975463552 00000100:00100000:3.0:1788832924.385242:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 223 00000100:00100000:3.0:1788832924.385255:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+64:11659:x1875726975463552:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832924.385289:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832924.385316:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5a28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55770 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.385401:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5a28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55770 expref: 65 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.385437:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5a28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55770 expref: 65 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.385462:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff984d03c60700) 00010000:00010000:3.0:1788832924.385466:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832924.385471:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2400, rc 0) 00000100:00100000:3.0:1788832924.385565:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+65:11659:x1875726975463552:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 312us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832924.385574:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 223 00010000:00010000:2.0:1788832924.386081:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.386094:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.386101:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.386107:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832924.386111:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.386121:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.386135:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff984d03c60700) 00010000:00010000:2.0:1788832924.386139:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788832924.386154:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.386162:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a5a21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832924.390948:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832924.391036:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975463680 00000100:00100000:3.0:1788832924.391050:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975463680 00000100:00100000:3.0:1788832924.391145:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 62 00000100:00100000:3.0:1788832924.391159:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2358:x1875726975463680:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788832924.391644:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832924.392006:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:2358:x1875726975463680:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 Request processed in 841us (1062us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788832924.392016:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 62 00000100:00100000:1.0:1788832924.404675:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.404791:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975463936 00000100:00100000:2.0:1788832924.404804:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975463936 00000100:00100000:2.0:1788832924.404875:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 60 00000100:00100000:2.0:1788832924.404886:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+64:11659:x1875726975463936:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788832924.405217:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+65:11659:x1875726975463936:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 331us (554us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788832924.405225:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 60 00000100:00100000:1.0:1788832924.414868:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.415254:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975464192 00000100:00100000:2.0:1788832924.415267:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975464192 00000100:00100000:2.0:1788832924.415366:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 224 00000100:00100000:2.0:1788832924.415378:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+65:11659:x1875726975464192:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788832924.415555:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+65:11659:x1875726975464192:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 179us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832924.415564:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 224 00000100:00100000:1.0:1788832924.422668:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832924.423191:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975464320 00000100:00100000:3.0:1788832924.423206:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975464320 00000100:00100000:3.0:1788832924.423288:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 225 00000100:00100000:3.0:1788832924.423299:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+65:11659:x1875726975464320:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832924.423325:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832924.423351:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55777 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.423592:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5a36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.423609:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.423640:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832924.423698:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788832924.423722:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.424139:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55777 expref: 67 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.424167:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55777 expref: 66 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.424177:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff984d03c60700) 00010000:00010000:3.0:1788832924.424180:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788832924.424185:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2c00, rc 0) 00000100:00100000:2.0:1788832924.425879:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+66:11659:x1875726975464320:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 2567us (3212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832924.425894:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 225 00000100:00100000:0.0:1788832924.436822:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832924.437175:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975464448 00000100:00100000:1.0:1788832924.437189:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975464448 00000100:00100000:1.0:1788832924.437263:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 63 00000100:00100000:1.0:1788832924.437274:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+10:2357:x1875726975464448:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832924.437296:0:8475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832924.437324:0:8475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000964f81fb/0xd270a10c1c6a5a3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5577e expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788832924.437354:0:8475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f6c9c, blocks: 0x1 00010000:00010000:1.0:1788832924.437396:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1788832924.437401:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832924.437412:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000964f81fb/0xd270a10c1c6a5a3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5577e expref: 11 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.437434:0:8475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000964f81fb/0xd270a10c1c6a5a3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5577e expref: 11 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.437450:0:8475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d9400, rc 0) 00000100:00100000:1.0:1788832924.437662:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:2357:x1875726975464448:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 388us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832924.437670:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 63 00000100:00100000:1.0:1788832924.445328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.445458:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975464704 00000100:00100000:2.0:1788832924.445472:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975464704 00000100:00100000:2.0:1788832924.445557:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 226 00000100:00100000:2.0:1788832924.445589:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+66:11659:x1875726975464704:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788832924.445789:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+66:11659:x1875726975464704:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 157us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832924.445798:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 226 00000100:00100000:3.0:1788832924.449184:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832924.449302:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975464832 00000100:00100000:1.0:1788832924.449315:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975464832 00000100:00100000:1.0:1788832924.449392:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 64 00000100:00100000:1.0:1788832924.449404:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:11659:x1875726975464832:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832924.449466:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832924.449503:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3dd5aea/0xd270a10c1c6a5a44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55785 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.449548:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000964f81fb/0xd270a10c1c6a5a3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5577e expref: 12 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.449560:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832924.449565:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832924.449591:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3dd5aea/0xd270a10c1c6a5a44 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55785 expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.449634:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000964f81fb/0xd270a10c1c6a5a3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5577e expref: 12 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.449652:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000964f81fb/0xd270a10c1c6a5a3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5577e expref: 12 pid: 8475 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832924.450109:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c067fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1875726994321536:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832924.450285:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c07b8cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832924.458608:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c067fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1875726994321536:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832924.458657:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3dd5aea/0xd270a10c1c6a5a44 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55785 expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.458696:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d8e00, rc 0) 00000100:00100000:1.0:1788832924.458824:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:11659:x1875726975464832:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 9421us (9653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832924.458834:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 64 00000100:00100000:3.0:1788832924.464167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832924.465287:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975464960 00000100:00100000:1.0:1788832924.465321:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975464960 00010000:00010000:1.0:1788832924.465384:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000964f81fb/0xd270a10c1c6a5a3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5577e expref: 12 pid: 8475 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832924.465459:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 82 00000100:00100000:1.0:1788832924.465472:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+12:2357:x1875726975464960:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832924.465521:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832924.465548:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000964f81fb/0xd270a10c1c6a5a3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5577e expref: 12 pid: 8475 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.465563:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000964f81fb/0xd270a10c1c6a5a3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5577e expref: 12 pid: 8475 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.465591:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000964f81fb/0xd270a10c1c6a5a3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5577e expref: 12 pid: 8475 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.465613:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832924.465618:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832924.465626:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3dd5aea/0xd270a10c1c6a5a44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55785 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.465637:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3dd5aea/0xd270a10c1c6a5a44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55785 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.465692:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f3dd5aea/0xd270a10c1c6a5a44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55785 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832924.465710:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c067fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5838:1875726994321664:192.168.206.41@tcp:105: 00000100:00100000:1.0:1788832924.466648:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c07b8cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832924.473186:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c067fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5838:1875726994321664:192.168.206.41@tcp:105: 00010000:00010000:1.0:1788832924.473222:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832924.473319:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:2357:x1875726975464960:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 7847us (9165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832924.473332:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 82 00000100:00100000:0.0:1788832924.476352:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.476562:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975465088 00000100:00100000:2.0:1788832924.476576:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975465088 00002000:00100000:2.0:1788832924.476647:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff984d3b7f0000 x1875726975465088/t0(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:110/0 lens 504/0 e 0 to 0 dl 1788832935 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788832924.476658:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3b7f0000 with x1875726975465088 ext(0->12) 00002000:00010000:2.0:1788832924.476665:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984d3b7f0000 00000100:00100000:2.0:1788832924.476703:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:2.0:1788832924.476714:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+11:2357:x1875726975465088:12345-192.168.206.41@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788832924.477790:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:2357:x1875726975465088:12345-192.168.206.41@tcp:4:lhsmtool_posix.0 Request processed in 1070us (1446us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788832924.477803:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 6 00002000:00100000:2.0:1788832924.477812:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff984d3b7f0000 x1875726975465088/t4294967320(0) o4->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:110/0 lens 504/448 e 0 to 0 dl 1788832935 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788832924.477822:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984d3b7f0000 with x1875726975465088 ext(0->12) 00002000:00010000:2.0:1788832924.477826:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984d3b7f0000 00000100:00100000:3.0:1788832924.480478:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832924.480791:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975465216 00000100:00100000:0.0:1788832924.480805:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975465216 00000100:00100000:0.0:1788832924.480889:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 227 00000100:00100000:0.0:1788832924.480901:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3bd54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+66:11659:x1875726975465216:12345-192.168.206.41@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788832924.555787:0:12463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00000004:00080000:1.0:1788832924.556080:0:12463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:1.0:1788832924.556108:0:12463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000100:00100000:1.0:1788832924.556454:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994321792:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788832924.556506:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1788832924.556518:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:2.0:1788832924.556542:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1788832924.556558:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788832924.556565:0:5875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984d3aeb76c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788832924.556571:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d3a143500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984d3aeb7d80 00000020:00080000:2.0:1788832924.556593:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d3a143f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984d3b2e5400 00000100:00100000:1.0:1788832924.556792:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832924.556801:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3bd55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994321920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788832924.556849:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832924.556935:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994321792 00000100:00100000:3.0:1788832924.556945:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994321792 00000100:00100000:3.0:1788832924.557015:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994321920 00000100:00100000:3.0:1788832924.557019:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994321920 00000100:00100000:3.0:1788832924.557040:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788832924.557213:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c067fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1875726994321792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788832924.557249:0:8475:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1788832924.557282:0:8475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.557322:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a580d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556e4 expref: 12 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.557333:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788832924.557338:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832924.557344:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.557390:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a580d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556e4 expref: 12 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.557406:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a580d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556e4 expref: 12 pid: 6700 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832924.557420:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8475:1875726994322048:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832924.557505:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d2da35cc0 going to sleep for 11 seconds 00000100:00080000:1.0:1788832924.557569:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832924.557591:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788832924.557601:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1875726994321920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788832924.557821:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788832924.557825:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788832924 00002000:00010000:1.0:1788832924.557828:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788832924.557830:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788832924 -> 1788832924 00002000:00010000:1.0:1788832924.557833:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788832924.557888:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3314:x1875726994321920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 288us (1037us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788832924.557896:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1788832924.557997:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984d3bd55180/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788832924.558005:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994321920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788832924.558994:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832924.559012:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994322176:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1788832924.559823:0:5875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984d06d77e40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788832924.559832:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d3a143a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984d06d773c0 00000020:00080000:2.0:1788832924.559836:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d3a143100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984d3a14c400 00000020:00080000:2.0:1788832924.559877:0:5875:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788832924.559906:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788832924.560151:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788832924.560197:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832924.560246:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994322176 00000100:00100000:2.0:1788832924.560256:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994322176 00000100:00100000:2.0:1788832924.560311:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788832924.560322:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1875726994322176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788832924.560357:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1788832924.560399:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f6c9b, atime: 0x6a9f6c9b, ctime: 0x6a9f6c9b, blocks: 0x1 00010000:00010000:2.0:1788832924.560410:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5a52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.560430:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788832924.560436:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832924.560443:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5a52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.560463:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5a52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.560476:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5a52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.560524:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5a52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.560555:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788832924.561038:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3bd54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:11659:x1875726975465216:12345-192.168.206.41@tcp:44:lhsmtool_posix.0 Request processed in 80134us (80568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832924.561050:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 227 00010000:00010000:1.0:1788832924.561375:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832924.561384:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5a52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.561404:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788832924.561409:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5a52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.561420:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5a52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.561441:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5a52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.561450:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5a52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.561469:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832924.561471:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832924.561472:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832924.564460:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3317:x1875726994322176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4122us (4247us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788832924.564477:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1788832924.564662:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984d3b939c00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788832924.564671:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994322176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788832924.565088:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832924.565131:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.565196:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975465344 00000100:00100000:2.0:1788832924.565206:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975465344 00000100:00100000:2.0:1788832924.565267:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 68 00000100:00100000:2.0:1788832924.565279:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:2357:x1875726975465344:12345-192.168.206.41@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788832924.565286:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8475:1875726994322048:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832924.565331:0:8475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832924.565713:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975465472 00000100:00100000:0.0:1788832924.565720:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975465472 00010000:00010000:0.0:1788832924.565788:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a580d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556e4 expref: 14 pid: 6700 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832924.565822:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 83 00000100:00100000:0.0:1788832924.565831:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+14:2357:x1875726975465472:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832924.565861:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832924.565868:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a580d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556e4 expref: 14 pid: 6700 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.565882:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a580d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556e4 expref: 14 pid: 6700 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.565913:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a580d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556e4 expref: 14 pid: 6700 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.566854:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788832924.566861:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788832924.566870:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.566885:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.567699:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832924.567826:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+13:2357:x1875726975465472:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 1988us (2733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832924.567839:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 83 00010000:00010000:1.0:1788832924.573266:0:8475:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.573322:0:8475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.573339:0:8475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.573347:0:8475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.573380:0:8475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788832924.573706:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832924.573715:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.573738:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788832924.573767:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.573777:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.574149:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.574161:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5a4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.575678:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832924.575686:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832924.575690:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832924.577322:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c067fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3314:x1875726994321792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20263us (20756us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788832924.577338:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1788832924.577881:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984d3bd54700/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788832924.577891:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994321792:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1788832924.618807:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:3.0:1788832924.618833:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1788832924.618839:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1788832924.619237:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975465344:12345-192.168.206.41@tcp:16:lhsmtool_posix.0 Request processed in 53951us (54095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832924.619251:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 68 00000100:00100000:3.0:1788832924.621205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832924.621377:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975465728 00000100:00100000:1.0:1788832924.621390:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975465728 00000100:00100000:1.0:1788832924.621475:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 228 00000100:00100000:1.0:1788832924.621498:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:11659:x1875726975465728:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788832924.621569:0:7174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832924.621604:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5a36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55777 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.621628:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff984d03c60700) 00010000:00010000:1.0:1788832924.621634:0:7174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832924.621676:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9a00/0xd270a10c1c6a5a59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.621714:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9a00/0xd270a10c1c6a5a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.621726:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9a00/0xd270a10c1c6a5a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832924.622299:0:7174:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f75cfee3 reply state 000000004ff93642 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9a00/0xd270a10c1c6a5a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832924.622312:0:7174:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832924.622502:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:11659:x1875726975465728:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 1005us (1308us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788832924.622513:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 228 00000100:00100000:2.0:1788832924.625699:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00010000:00010000:0.0:1788832924.625843:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9a00/0xd270a10c1c6a5a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.625874:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9a00/0xd270a10c1c6a5a59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.625883:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9a00/0xd270a10c1c6a5a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.625889:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d9a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832924.625896:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9a00/0xd270a10c1c6a5a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.625905:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9a00/0xd270a10c1c6a5a59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.625937:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff984d03c60700) 00010000:00010000:0.0:1788832924.625941:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832924.625947:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9a00/0xd270a10c1c6a5a59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.625954:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9a00/0xd270a10c1c6a5a59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832924.627101:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975465856 00000100:00100000:3.0:1788832924.627120:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975465856 00000100:00100000:3.0:1788832924.627194:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 69 00000100:00100000:3.0:1788832924.627206:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975465856:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788832924.627659:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788832924.627676:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788832924 -> 1788832924 00002000:00010000:3.0:1788832924.627679:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788832923 00002000:00010000:3.0:1788832924.627682:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788832924 -> 1788832924 00002000:00010000:3.0:1788832924.627685:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788832924.628153:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2357:x1875726975465856:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 Request processed in 946us (2463us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788832924.628164:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 69 00000100:00100000:1.0:1788832924.631291:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832924.631468:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975466112 00000100:00100000:3.0:1788832924.631493:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975466112 00000100:00100000:3.0:1788832924.631601:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 229 00000100:00100000:3.0:1788832924.631614:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:11659:x1875726975466112:12345-192.168.206.41@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788832924.631711:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.631732:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a5a1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55769 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.632007:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.632066:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a5a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55769 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.632086:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a5a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55769 expref: 20 pid: 5854 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832924.632106:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994322304:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788832924.632255:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d2da35000 going to sleep for 11 seconds 00000100:00100000:3.0:1788832924.636088:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.636303:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1875726994322304:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788832924.636348:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832924.636863:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975466240 00000100:00100000:0.0:1788832924.636873:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975466240 00010000:00010000:0.0:1788832924.637049:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a5a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55769 expref: 21 pid: 5854 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832924.637098:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 84 00000100:00100000:0.0:1788832924.637110:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:2357:x1875726975466240:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832924.637127:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832924.637152:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a5a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55769 expref: 21 pid: 5854 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.637166:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a5a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55769 expref: 21 pid: 5854 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.637195:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba400/0xd270a10c1c6a5a1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55769 expref: 21 pid: 5854 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.637215:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff984d03c60700) 00010000:00010000:0.0:1788832924.637221:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.637232:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.637240:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832924.637276:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832924.637535:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:2357:x1875726975466240:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 426us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832924.637545:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 84 00010000:00010000:2.0:1788832924.638241:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.638253:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.638291:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.638326:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.638333:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.638340:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788832924.638345:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.638353:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.638366:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff984d03c60700) 00010000:00010000:2.0:1788832924.638369:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788832924.638374:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.638380:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a5a60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832924.638466:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:11659:x1875726975466112:12345-192.168.206.41@tcp:55:lhsmtool_posix.0 Request processed in 6853us (7186us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788832924.638475:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 229 00000100:00100000:3.0:1788832924.642194:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832924.642368:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975466368 00000100:00100000:1.0:1788832924.642382:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975466368 00000100:00100000:1.0:1788832924.642507:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 70 00000100:00100000:1.0:1788832924.642520:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2358:x1875726975466368:12345-192.168.206.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788832924.642581:0:8475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.642608:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3dd5aea/0xd270a10c1c6a5a44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55785 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.642617:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832924.642623:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788832924.642628:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.642690:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3dd5aea/0xd270a10c1c6a5a44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55785 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.642707:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3dd5aea/0xd270a10c1c6a5a44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55785 expref: 8 pid: 6699 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832924.642725:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b939f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8475:1875726994322432:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832924.642882:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c07b8c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788832924.646712:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.647051:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975466496 00000100:00100000:2.0:1788832924.647064:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975466496 00010000:00010000:2.0:1788832924.647117:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3dd5aea/0xd270a10c1c6a5a44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55785 expref: 9 pid: 6699 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832924.647159:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 85 00000100:00100000:2.0:1788832924.647189:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2358:x1875726975466496:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832924.647209:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832924.647239:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3dd5aea/0xd270a10c1c6a5a44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55785 expref: 9 pid: 6699 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.647255:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3dd5aea/0xd270a10c1c6a5a44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55785 expref: 9 pid: 6699 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.647287:0:7639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832924.647293:0:7639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832924.647299:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.647311:0:7639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.647336:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832924.647402:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+9:2358:x1875726975466496:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 216us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832924.647410:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 85 00010000:00010000:1.0:1788832924.647710:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3dd5aea/0xd270a10c1c6a5a44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55785 expref: 8 pid: 6699 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832924.647728:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b939f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8475:1875726994322432:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832924.647826:0:8475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.647838:0:8475:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.647846:0:8475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.647877:0:8475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.647900:0:8475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.647908:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.647988:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d9c00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788832924.647993:0:8475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.648005:0:8475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.648020:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.648028:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a2665e1/0xd270a10c1c6a5a67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832924.648090:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2358:x1875726975466368:12345-192.168.206.41@tcp:1:lhsmtool_posix.0 Request processed in 5572us (5913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832924.648100:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 70 00000100:00100000:3.0:1788832924.651505:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.651704:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975466752 00000100:00100000:2.0:1788832924.651717:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975466752 00000100:00100000:2.0:1788832924.652014:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 230 00000100:00100000:2.0:1788832924.652028:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:11659:x1875726975466752:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788832924.652133:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5a6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.652179:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.652193:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.652612:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.652627:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5a28 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55770 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.652637:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.652681:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5a28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55770 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.652697:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5a28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55770 expref: 20 pid: 5855 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832924.652713:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994322560:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788832924.654504:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10363180 going to sleep for 11 seconds 00000100:00100000:2.0:1788832924.658576:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832924.658686:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994322560:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788832924.658725:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832924.659183:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975466880 00000100:00100000:1.0:1788832924.659194:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975466880 00010000:00010000:1.0:1788832924.659245:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5a28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55770 expref: 21 pid: 5855 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832924.659298:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 86 00000100:00100000:1.0:1788832924.659322:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:2357:x1875726975466880:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832924.659346:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832924.659354:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5a28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55770 expref: 21 pid: 5855 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.659367:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5a28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55770 expref: 21 pid: 5855 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.659394:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5a28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55770 expref: 21 pid: 5855 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.659413:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff984d03c60700) 00010000:00010000:1.0:1788832924.659419:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.659429:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.659436:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.659459:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832924.659646:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.659655:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788832924.660328:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788832924.660562:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788832924.660612:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788832924.660718:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5853:1875726994322688:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788832924.660827:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832924.660874:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d2da35540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832924.660910:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994322688 00000100:00100000:3.0:1788832924.661057:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994322688 00000100:00100000:3.0:1788832924.661114:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788832924.661124:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875726994322688:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788832924.661208:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875726994322688:12345-0@lo:1000:mdt00_000.0 Request processed in 85us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832924.661217:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788832924.661260:0:5853:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1788832924.661266:0:5853:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1788832924.661318:0:5853:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984d3bd55180, transno 4294967321 00000100:00100000:3.0:1788832924.661333:0:5853:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff984d3bd54700 x1875726994321792/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788832940 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832924.661347:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5853:1875726994322688:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788832924.661880:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788832924.662489:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5853:1875726994322816:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788832924.662563:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832924.662599:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d2da35600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832924.663178:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994322816 00000100:00100000:3.0:1788832924.663189:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994322816 00000100:00100000:3.0:1788832924.663244:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788832924.663254:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875726994322816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788832924.663500:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5853:x1875726994322816:12345-0@lo:1000:mdt00_000.0 Request processed in 246us (935us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788832924.663508:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788832924.663566:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5853:1875726994322816:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788832924.663785:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.663797:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.663816:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.663825:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832924.663830:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.663858:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.663880:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff984d03c60700) 00010000:00010000:3.0:1788832924.663883:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832924.663890:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.663897:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a5a75 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.663953:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a59b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.663960:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a59b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.663965:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a59b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.663971:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d8800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788832924.663974:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a59b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.663980:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a59b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.663988:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:3.0:1788832924.663991:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832924.663999:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a59bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55754 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.664023:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a59bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55754 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.664033:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a59bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55754 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.664070:0:5853:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a59bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55754 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832924.664086:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994322944:192.168.206.41@tcp:105: 00000100:00100000:1.0:1788832924.664831:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+24:2357:x1875726975466880:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 5515us (6262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832924.664847:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 86 00000100:00100000:3.0:1788832924.667723:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d2da35600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832924.671777:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.672666:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975467008 00000100:00100000:2.0:1788832924.672681:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975467008 00000100:00100000:2.0:1788832924.672818:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 61 00000100:00100000:2.0:1788832924.672830:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+24:11658:x1875726975467008:12345-192.168.206.41@tcp:49:lfs.0 00000100:00100000:2.0:1788832924.673236:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+24:11658:x1875726975467008:12345-192.168.206.41@tcp:49:lfs.0 Request processed in 406us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832924.673245:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 61 00000100:00100000:1.0:1788832924.676698:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5853:1875726994322944:192.168.206.41@tcp:105: 00010000:00010000:1.0:1788832924.677066:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a59b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677080:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a59b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677587:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5a7c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677607:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5a7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677622:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5a7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677636:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5a7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677643:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5a7c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677651:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5a7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677658:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d9c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832924.677663:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5a7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677671:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5a7c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677684:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:1.0:1788832924.677688:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832924.677704:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5a7c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677711:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5a7c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677723:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677729:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5a6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677735:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5a6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677779:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832924.677783:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5a6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677790:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5a6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677808:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:1.0:1788832924.677811:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788832924.677814:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5a6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.677820:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702000/0xd270a10c1c6a5a6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788832924.678847:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832924.678857:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832924.679382:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788832924.679395:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788832924.680274:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+23:11659:x1875726975466752:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 28237us (28781us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788832924.680289:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 230 00000020:00080000:1.0:1788832924.680314:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788832924.680587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832924.683886:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832924.684209:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975467520 00000100:00100000:3.0:1788832924.684222:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975467520 00000100:00100000:3.0:1788832924.684292:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 62 00000100:00100000:3.0:1788832924.684303:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d033df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+23:11659:x1875726975467520:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788832924.686224:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1788832924.686642:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975467264 00000100:00100000:2.0:1788832924.686657:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975467264 00000100:00100000:2.0:1788832924.686739:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 231 00000100:00100000:2.0:1788832924.687144:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+25:11658:x1875726975467264:12345-192.168.206.41@tcp:58:lfs.0 00000001:00080000:3.0:1788832924.687541:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788832924.687635:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5a83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.687658:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5a83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.687672:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5a83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.687700:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5a83 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.687707:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5a83 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.687714:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5a83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832924.687766:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788832924.687900:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d033df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:11659:x1875726975467520:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 3598us (4029us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788832924.688204:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 62 00000020:00080000:3.0:1788832924.688214:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1788832924.688643:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788832924.688715:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+25:11658:x1875726975467264:12345-192.168.206.41@tcp:58:lfs.0 Request processed in 1574us (8126us total) trans 0 rc 0/0 00010000:00010000:1.0:1788832924.688782:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832924.688792:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5a83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.688815:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3e00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788832924.688819:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5a83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.688829:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5a83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.688847:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff984d07e81c00) 00010000:00010000:1.0:1788832924.688851:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788832924.688857:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5a83 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.688863:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a5a83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.688886:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832924.688888:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832924.688890:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832924.695640:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 231 00000100:00100000:0.0:1788832924.737214:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832924.737676:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975467648 00000100:00100000:1.0:1788832924.737690:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975467648 00000100:00100000:1.0:1788832924.737977:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 232 00000100:00100000:1.0:1788832924.737992:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+25:11661:x1875726975467648:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832924.738024:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832924.738053:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5a8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5578c expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.738172:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5a91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.738190:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5a91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.738204:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5a91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.738221:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8e00/0xd270a10c1c6a5a98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.738229:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8e00/0xd270a10c1c6a5a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.738235:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8e00/0xd270a10c1c6a5a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.738571:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8c00/0xd270a10c1c6a5a9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.738585:0:7174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5574d expref: 26 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.738596:0:7174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8c00/0xd270a10c1c6a5a9f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.738639:0:7174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5574d expref: 26 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.738671:0:7174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5574d expref: 26 pid: 5853 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832924.738689:0:7174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b939f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994323072:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788832924.738877:0:7174:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c07b8c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832924.746313:0:7174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b939f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7174:1875726994323072:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788832924.746563:0:7174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8c00/0xd270a10c1c6a5a9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832924.748301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832924.748571:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975467904 00000100:00100000:1.0:1788832924.748644:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975467904 00000100:00100000:1.0:1788832924.748715:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 63 00000100:00100000:1.0:1788832924.748725:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+27:5595:x1875726975467904:12345-192.168.206.41@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788832924.749208:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+28:5595:x1875726975467904:12345-192.168.206.41@tcp:35:ldlm_bl.0 Request processed in 481us (917us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788832924.749218:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 63 00000100:00100000:3.0:1788832924.751164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832924.751271:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975468032 00000100:00100000:2.0:1788832924.751283:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975468032 00010000:00010000:2.0:1788832924.751338:0:7639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5574d expref: 28 pid: 5853 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832924.751385:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 87 00000100:00100000:2.0:1788832924.751399:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+28:2358:x1875726975468032:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832924.751419:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832924.751427:0:7639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5574d expref: 28 pid: 5853 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.751472:0:7639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5574d expref: 28 pid: 5853 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.751508:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bba00/0xd270a10c1c6a59aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5574d expref: 28 pid: 5853 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.751527:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:2.0:1788832924.751533:0:7639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8c00/0xd270a10c1c6a5a9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.751543:0:7639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8c00/0xd270a10c1c6a5a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832924.751550:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8c00/0xd270a10c1c6a5a9f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751677:0:7174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8c00/0xd270a10c1c6a5a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751686:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8c00/0xd270a10c1c6a5a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832924.751738:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788832924.751779:0:7174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788832924.751801:0:7174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8c00/0xd270a10c1c6a5a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751826:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8c00/0xd270a10c1c6a5a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751836:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5a91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751843:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5a91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751850:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5a91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751855:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d8800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832924.751860:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5a91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751867:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5a91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751875:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:1.0:1788832924.751877:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832924.751881:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5a91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751886:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5a91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751898:0:7174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8e00/0xd270a10c1c6a5a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751904:0:7174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8e00/0xd270a10c1c6a5a98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751916:0:7174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8e00/0xd270a10c1c6a5a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751921:0:7174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d8e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832924.751924:0:7174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8e00/0xd270a10c1c6a5a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751931:0:7174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8e00/0xd270a10c1c6a5a98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751939:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff984d02d42e00) 00010000:00010000:1.0:1788832924.751941:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832924.751944:0:7174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8e00/0xd270a10c1c6a5a98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751949:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8e00/0xd270a10c1c6a5a98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.751989:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d9c00/0xd270a10c1c6a5a8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5578c expref: 28 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.752004:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8c00/0xd270a10c1c6a5a9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5578c expref: 27 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832924.752012:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:1.0:1788832924.752014:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832924.752017:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d8c00, rc 0) 00000100:00100000:1.0:1788832924.752089:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+27:11661:x1875726975467648:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 14102us (14891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832924.752106:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 232 00010000:00010000:2.0:1788832924.752545:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832924.752710:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:2358:x1875726975468032:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 1313us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832924.752719:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 87 00010000:00010000:1.0:1788832925.273041:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788832925.614950:0:12581:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788832925.614964:0:12581:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788832925.615014:0:12581:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788832925.615020:0:12581:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788832925.724687:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832925.724699:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832925.724813:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788832925.724826:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832925.725001:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9e6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875726994323200:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832925.725127:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d112efe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832925.741852:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9e6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875726994323200:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832925.742651:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832925.742793:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975468160 00000100:00100000:2.0:1788832925.742803:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975468160 00000100:00100000:2.0:1788832925.742877:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 233 00000100:00100000:2.0:1788832925.742889:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:11673:x1875726975468160:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788832925.742935:0:5855:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788832925.743071:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:11673:x1875726975468160:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 Request processed in 183us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832925.743090:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 233 00000100:00080000:1.0:1788832925.743422:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832925.758490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832925.758674:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975468416 00000100:00100000:1.0:1788832925.758687:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975468416 00000100:00100000:1.0:1788832925.758957:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 234 00000100:00100000:1.0:1788832925.758971:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+26:11673:x1875726975468416:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832925.759001:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832925.759027:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8e00/0xd270a10c1c6a5aa6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55793 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.759158:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5aad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.759175:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.759191:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832925.759205:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788832925.759357:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8e00/0xd270a10c1c6a5aa6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55793 expref: 29 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.759375:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55793 expref: 28 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.759384:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:1.0:1788832925.759412:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832925.759416:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d8800, rc 0) 00000100:00100000:1.0:1788832925.759491:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+28:11673:x1875726975468416:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 523us (1019us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788832925.759499:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 234 00000100:00100000:0.0:1788832925.765489:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832925.765681:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975468544 00000100:00100000:3.0:1788832925.765694:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975468544 00000100:00100000:0.0:1788832925.765953:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 18 00000100:00100000:0.0:1788832925.765968:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+28:2358:x1875726975468544:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832925.765989:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832925.766022:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8800/0xd270a10c1c6a5aad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55793 expref: 28 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832925.766047:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:0.0:1788832925.766053:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832925.766121:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+27:2358:x1875726975468544:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 158us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832925.766130:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 18 00000100:00100000:3.0:1788832925.768414:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832925.768560:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975468800 00000100:00100000:1.0:1788832925.768573:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975468800 00000100:00100000:1.0:1788832925.768652:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 235 00000100:00100000:1.0:1788832925.768664:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+27:11673:x1875726975468800:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788832925.768811:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8000/0xd270a10c1c6a5abb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.768832:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8000/0xd270a10c1c6a5abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.768847:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8000/0xd270a10c1c6a5abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.769106:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8000/0xd270a10c1c6a5abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.769115:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8000/0xd270a10c1c6a5abb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.769123:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8000/0xd270a10c1c6a5abb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.769130:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d8000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788832925.769135:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8000/0xd270a10c1c6a5abb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.769155:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8000/0xd270a10c1c6a5abb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.769175:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:1.0:1788832925.769179:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788832925.769184:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8000/0xd270a10c1c6a5abb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832925.769191:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8000/0xd270a10c1c6a5abb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832925.769379:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+28:11673:x1875726975468800:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 716us (988us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788832925.769388:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 235 00000040:00080000:1.0:1788832925.769560:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788832925.769566:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788832925.770061:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788832925.770071:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832925.772883:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832925.773148:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975469056 00000100:00100000:3.0:1788832925.773160:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975469056 00000100:00100000:3.0:1788832925.773248:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 64 00000100:00100000:3.0:1788832925.773260:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+28:11673:x1875726975469056:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788832925.773552:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+29:11673:x1875726975469056:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 293us (682us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788832925.773570:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 64 00010000:00010000:3.0:1788832926.293971:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788832926.418387:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788832926.418414:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1788832926.418425:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:0.0:1788832927.318190:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788832927.484507:0:12634:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788832927.484518:0:12634:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788832927.484564:0:12634:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788832927.484570:0:12634:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788832927.646253:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832927.646492:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975469312 00000100:00100000:1.0:1788832927.646502:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975469312 00000100:00080000:3.0:1788832927.646539:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832927.646566:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 236 00000100:00100000:1.0:1788832927.648732:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+29:11694:x1875726975469312:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788832927.648780:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832927.648808:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8200/0xd270a10c1c6a5ac2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5579a expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832927.648910:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8600/0xd270a10c1c6a5ac9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832927.648926:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8600/0xd270a10c1c6a5ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832927.648939:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8600/0xd270a10c1c6a5ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832927.648951:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788832927.649073:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8200/0xd270a10c1c6a5ac2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5579a expref: 32 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832927.649089:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8600/0xd270a10c1c6a5ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5579a expref: 31 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832927.649097:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:1.0:1788832927.649100:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788832927.649103:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d8600, rc 0) 00000100:00100000:1.0:1788832927.649169:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+31:11694:x1875726975469312:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 2595us (2924us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788832927.649178:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 236 00000100:00100000:0.0:1788832927.658549:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832927.658770:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975469440 00000100:00100000:0.0:1788832927.658779:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975469440 00000100:00100000:0.0:1788832927.658825:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 237 00000100:00100000:0.0:1788832927.658834:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+31:11694:x1875726975469440:12345-192.168.206.41@tcp:54:lfs.0 00010000:00010000:0.0:1788832927.658901:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5ad7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832927.658919:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832927.658930:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832927.658954:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832927.658960:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832927.658967:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832927.658973:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788832927.658977:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832927.658984:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832927.658995:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:0.0:1788832927.658998:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788832927.659001:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5ad7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832927.659007:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5ad7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832927.659375:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+31:11694:x1875726975469440:12345-192.168.206.41@tcp:54:lfs.0 Request processed in 539us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832927.659383:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 237 00000100:00100000:0.0:1788832927.725153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832927.725242:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975469568 00000100:00100000:3.0:1788832927.725251:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975469568 00000100:00100000:3.0:1788832927.725314:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 71 00000100:00100000:3.0:1788832927.725323:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1817dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975469568:12345-192.168.206.41@tcp:101:cat.0 00010000:00010000:3.0:1788832927.725340:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832927.725357:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5ade lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b557a1 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832927.725379:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f6c9c, atime: 0x6a9f6c9b, ctime: 0x6a9f6c9c, blocks: 0xb 00010000:00010000:3.0:1788832927.725396:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=431s v=(0 0) 00010000:00010000:3.0:1788832927.725400:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832927.725409:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5ade lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557a1 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832927.725425:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5ade lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557a1 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832927.725439:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3800, rc 0) 00000100:00100000:3.0:1788832927.725499:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1817dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2357:x1875726975469568:12345-192.168.206.41@tcp:101:cat.0 Request processed in 177us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832927.725506:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 71 00000100:00080000:1.0:1788832927.725659:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832927.731507:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832927.731596:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975469696 00000100:00100000:3.0:1788832927.731619:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975469696 00002000:00100000:3.0:1788832927.731674:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff984c04ba5c00 x1875726975469696/t0(0) o3->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:113/0 lens 488/0 e 0 to 0 dl 1788832938 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788832927.731684:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984c04ba5c00 with x1875726975469696 ext(0->4095) 00002000:00010000:3.0:1788832927.731690:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984c04ba5c00 00000100:00100000:3.0:1788832927.731724:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:3.0:1788832927.731774:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2358:x1875726975469696:12345-192.168.206.41@tcp:3:cat.0 00000100:00100000:3.0:1788832927.731967:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2358:x1875726975469696:12345-192.168.206.41@tcp:3:cat.0 Request processed in 234us (468us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788832927.731975:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 7 00002000:00100000:3.0:1788832927.731981:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff984c04ba5c00 x1875726975469696/t0(0) o3->bee6676f-b533-4465-8162-bf8b5e1e90e6@192.168.206.41@tcp:113/0 lens 488/4536 e 0 to 0 dl 1788832938 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788832927.731990:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff984c04ba5c00 with x1875726975469696 ext(0->4095) 00002000:00010000:3.0:1788832927.731993:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff984c04ba5c00 00000100:00100000:1.0:1788832927.894018:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832927.894041:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994323712:0@lo:400:kworker.0 00000100:00100000:0.0:1788832927.894058:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994323584:0@lo:400:kworker.0 00000100:00100000:1.0:1788832927.894111:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832927.894147:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994323712 00000100:00100000:0.0:1788832927.894155:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994323712 00000100:00100000:1.0:1788832927.894185:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994323328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832927.894218:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788832927.894234:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994323712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832927.894235:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832927.894266:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832927.894274:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994323840:0@lo:400:kworker.0 00000100:00100000:0.0:1788832927.894294:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994323712:12345-0@lo:400:kworker.0 Request processed in 66us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832927.894303:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788832927.894309:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832927.894337:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994323840 00000100:00100000:0.0:1788832927.894342:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994323840 00000100:00100000:1.0:1788832927.894351:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994323712:0@lo:400:kworker.0 00000100:00100000:0.0:1788832927.894379:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788832927.894390:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832927.894395:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832927.894406:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994323840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832927.894407:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832927.894432:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994324096:0@lo:400:kworker.0 00000100:00100000:0.0:1788832927.894458:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994323840:12345-0@lo:400:kworker.0 Request processed in 55us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832927.894478:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788832927.894481:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832927.894503:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788832927.894504:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994324096 00000100:00100000:0.0:1788832927.894510:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994324096 00000100:00100000:1.0:1788832927.894513:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994323456:0@lo:400:kworker.0 00000100:00100000:0.0:1788832927.894546:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788832927.894552:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832927.894559:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1875726994324096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832927.894584:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994323968:0@lo:400:kworker.0 00000100:00100000:0.0:1788832927.894600:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1875726994324096:12345-0@lo:400:kworker.0 Request processed in 44us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832927.894616:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832927.894621:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788832927.894646:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994323584 00000100:00100000:1.0:1788832927.894650:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994324096:0@lo:400:kworker.0 00000100:00100000:0.0:1788832927.894652:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994323584 00000100:00100000:1.0:1788832927.894679:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994323456 00000100:00100000:0.0:1788832927.894682:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994323968 00000100:00100000:1.0:1788832927.894685:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994323456 00000100:00100000:0.0:1788832927.894687:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994323968 00000100:00100000:0.0:1788832927.894714:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788832927.894721:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994323584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832927.894786:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994323584:12345-0@lo:400:kworker.0 Request processed in 64us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832927.894792:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788832927.894805:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788832927.894811:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994323968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832927.894843:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994323328 00000100:00100000:2.0:1788832927.894849:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994323328 00000100:00100000:0.0:1788832927.894856:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875726994323968:12345-0@lo:400:kworker.0 Request processed in 45us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832927.894864:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788832927.894885:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788832927.894896:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875726994323328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832927.894923:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832927.894928:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788832927.894935:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984d3b947b80, transno 4294967307 00000004:00080000:0.0:1788832927.894945:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788832927.894962:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984d3b939c00, transno 4294967310 00000100:00100000:2.0:1788832927.894963:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875726994323328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832927.894972:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994323840:0@lo:400:kworker.0 00000100:00100000:2.0:1788832927.894975:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788832927.895003:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994323328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832927.895062:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994323968:0@lo:400:kworker.0 00000100:00100000:0.0:1788832927.895073:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994323584:0@lo:400:kworker.0 00000100:00080000:2.0:1788832927.895238:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832927.895241:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832927.895404:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788832927.895416:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994323456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832927.895472:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3315:x1875726994323456:12345-0@lo:400:kworker.0 Request processed in 50us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832927.895523:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd32c45e-9a6a-4349-b87e-107522b34816:3315:1875726994323456:0@lo:400:kworker.0 00000100:00100000:1.0:1788832927.898211:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788832928.095109:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832928.095246:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832928.096151:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832928.096197:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832928.096222:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832928.096273:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975470336 00000100:00100000:3.0:1788832928.096282:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975470336 00000100:00100000:3.0:1788832928.096340:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975469952 00000100:00100000:3.0:1788832928.096344:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975469952 00000100:00100000:3.0:1788832928.096365:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 160 00000100:00100000:3.0:1788832928.096373:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2357:x1875726975470336:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832928.096443:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2357:x1875726975470336:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 70us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832928.096451:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 160 00000100:00100000:3.0:1788832928.096477:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 161 00000100:00100000:3.0:1788832928.096484:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+31:2357:x1875726975469952:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832928.096522:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+31:2357:x1875726975469952:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 39us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832928.096529:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 161 00000100:00080000:3.0:1788832928.096665:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832928.097280:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975469824 00000100:00100000:1.0:1788832928.097288:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975469824 00000100:00100000:1.0:1788832928.097342:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 299 00000100:00100000:1.0:1788832928.097360:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2357:x1875726975469824:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832928.097405:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2357:x1875726975469824:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 47us (2304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832928.097413:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 299 00000100:00100000:2.0:1788832928.098255:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975470080 00000100:00100000:2.0:1788832928.098271:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975470080 00000100:00100000:2.0:1788832928.098357:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975470208 00000100:00100000:2.0:1788832928.098361:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975470208 00000100:00100000:2.0:1788832928.098396:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 79 00000100:00100000:2.0:1788832928.098404:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2357:x1875726975470080:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832928.098448:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2357:x1875726975470080:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 46us (3203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832928.098456:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 79 00000100:00100000:2.0:1788832928.098481:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 80 00000100:00100000:2.0:1788832928.098488:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2357:x1875726975470208:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832928.098514:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+8:2357:x1875726975470208:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 26us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832928.098532:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 80 00000100:00080000:3.0:1788832928.099479:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788832928.343013:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832929.365930:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832929.431783:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994324224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832929.431855:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832929.432124:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994324224 00000100:00100000:1.0:1788832929.432132:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994324224 00000100:00100000:1.0:1788832929.432193:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788832929.432202:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994324224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832929.432234:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832929.432287:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994324224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832929.432294:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788832929.432372:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994324224:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788832929.432471:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788832930.036915:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1788832930.041220:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1788832930.041236:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1788832930.042662:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1788832930.042698:0:5875:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788832930.042736:0:5875:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff984d2da35540 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788832930.042764:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d298d7f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff984d2da350c0 00000020:00080000:2.0:1788832930.042768:0:5875:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff984d298d7a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff984d02d3c000 00000020:00080000:0.0:1788832930.042842:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788832930.043020:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788832930.390992:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788832930.902911:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832930.902919:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832930.902958:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788832930.902965:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788832931.413876:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832932.437936:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832932.511947:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832932.512193:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975470464 00000100:00100000:3.0:1788832932.512202:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975470464 00000100:00100000:3.0:1788832932.512279:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 238 00000100:00100000:3.0:1788832932.512291:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:11347:x1875726975470464:12345-192.168.206.41@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788832932.512386:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:11347:x1875726975470464:12345-192.168.206.41@tcp:60:lhsmtool_posix.0 Request processed in 97us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832932.512394:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 238 00000100:00080000:2.0:1788832932.512471:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832932.523918:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832932.524122:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975470720 00000100:00100000:3.0:1788832932.524132:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975470720 00000100:00100000:3.0:1788832932.524235:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 65 00000100:00100000:3.0:1788832932.524246:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:11347:x1875726975470720:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788832932.524591:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:11347:x1875726975470720:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 345us (1397us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788832932.524599:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 65 00000100:00100000:1.0:1788832932.943378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832932.946169:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975470848 00000100:00100000:3.0:1788832932.946184:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975470848 00000100:00100000:3.0:1788832932.946337:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 239 00000100:00100000:3.0:1788832932.946348:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:12146:x1875726975470848:12345-192.168.206.41@tcp:101:lsof.0 00010000:00010000:3.0:1788832932.946381:0:7174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832932.946402:0:7174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5ae5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b557a8 expref: -99 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832932.948449:0:7174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5aec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832932.948478:0:7174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832932.948490:0:7174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832932.948524:0:7174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788832932.948528:0:7174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788832932.948548:0:7174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832932.948577:0:7174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2c00/0xd270a10c1c6a5ae5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557a8 expref: 7 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832932.948595:0:7174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5aec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557a8 expref: 6 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832932.948604:0:7174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:3.0:1788832932.948607:0:7174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832932.948611:0:7174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2400, rc 0) 00000100:00100000:3.0:1788832932.948686:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:12146:x1875726975470848:12345-192.168.206.41@tcp:101:lsof.0 Request processed in 2340us (5317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832932.948695:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 239 00000100:00080000:2.0:1788832932.950156:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832933.014336:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994324352:0@lo:400:kworker.0 00000100:00100000:3.0:1788832933.014419:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832933.014554:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994324352 00000100:00100000:0.0:1788832933.014563:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994324352 00000100:00100000:0.0:1788832933.014611:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788832933.014619:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994324352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832933.014714:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832933.014726:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994324480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832933.014791:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832933.014840:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994324480 00000100:00100000:1.0:1788832933.014844:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994324480 00000100:00100000:1.0:1788832933.014890:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788832933.014897:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994324480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832933.014923:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832933.014962:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994324480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832933.014969:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788832933.015041:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788832933.015046:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984d3bd54700, transno 4294967322 00000004:00080000:1.0:1788832933.015057:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788832933.015083:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994324480:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788832933.015401:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832933.017993:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994324736:0@lo:400:kworker.0 00000100:00100000:1.0:1788832933.018067:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832933.018123:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832933.018131:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994324608:0@lo:400:kworker.0 00000100:00100000:1.0:1788832933.018155:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832933.018201:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994324736 00000100:00100000:1.0:1788832933.018207:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994324736 00000100:00100000:1.0:1788832933.018252:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994324608 00000100:00100000:1.0:1788832933.018256:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994324608 00000100:00100000:1.0:1788832933.018277:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788832933.018285:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994324736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832933.018331:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994324736:12345-0@lo:400:kworker.0 Request processed in 47us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832933.018339:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788832933.018354:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788832933.018360:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994324608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832933.018389:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994324608:12345-0@lo:400:kworker.0 Request processed in 29us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832933.018394:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788832933.018425:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994324608:0@lo:400:kworker.0 00000100:00080000:1.0:1788832933.018459:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832933.018490:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994324736:0@lo:400:kworker.0 00000100:00100000:0.0:1788832933.019031:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994324352:12345-0@lo:400:kworker.0 Request processed in 4402us (4602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832933.019045:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788832933.019311:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994324352:0@lo:400:kworker.0 00000100:00100000:3.0:1788832933.019529:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994324864:0@lo:400:kworker.0 00000100:00100000:3.0:1788832933.019564:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832933.019626:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994324864 00000100:00100000:1.0:1788832933.019632:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994324864 00000100:00100000:1.0:1788832933.019684:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788832933.019692:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994324864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832933.019862:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994324992:0@lo:400:kworker.0 00000100:00100000:2.0:1788832933.019892:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832933.020406:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994324992 00000100:00100000:2.0:1788832933.020412:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994324992 00000100:00100000:2.0:1788832933.020807:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1788832933.020807:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832933.020811:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832933.020817:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994324992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832933.020863:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994324992:12345-0@lo:400:kworker.0 Request processed in 48us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832933.020881:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994324992:0@lo:400:kworker.0 00000100:00100000:2.0:1788832933.020883:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788832933.021158:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994324864:12345-0@lo:400:kworker.0 Request processed in 1466us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832933.021166:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788832933.021220:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994324864:0@lo:400:kworker.0 00000100:00100000:0.0:1788832933.211429:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832933.211480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832933.211689:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975471104 00000100:00100000:1.0:1788832933.211697:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975471104 00000100:00100000:1.0:1788832933.211783:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 165 00000100:00100000:1.0:1788832933.211795:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:2357:x1875726975471104:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832933.211878:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:2357:x1875726975471104:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 86us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832933.211886:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 165 00000100:00100000:0.0:1788832933.212046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832933.212084:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832933.212121:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975470976 00000100:00100000:1.0:1788832933.212125:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975470976 00000100:00100000:1.0:1788832933.212165:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 301 00000100:00100000:1.0:1788832933.212173:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2357:x1875726975470976:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788832933.212208:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2357:x1875726975470976:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 36us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832933.212215:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 301 00000100:00100000:2.0:1788832933.215418:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975471360 00000100:00100000:2.0:1788832933.215433:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975471360 00000100:00100000:2.0:1788832933.215526:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975471232 00000100:00100000:2.0:1788832933.215531:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975471232 00000100:00100000:2.0:1788832933.216386:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 82 00000100:00100000:2.0:1788832933.216402:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975471360:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832933.216498:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2357:x1875726975471360:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 101us (5015us total) trans 0 rc 0/0 00000100:00080000:0.0:1788832933.216549:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788832933.216554:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832933.218668:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 83 00000100:00100000:3.0:1788832933.218693:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2357:x1875726975471232:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832933.218699:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 82 00000100:00100000:3.0:1788832933.218790:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2357:x1875726975471232:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 110us (6704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832933.218798:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 83 00010000:00010000:1.0:1788832933.462147:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832934.486009:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832934.550014:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832934.550036:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994325120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832934.550115:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832934.550577:0:11720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994325120 00000100:00100000:1.0:1788832934.550585:0:11720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994325120 00000100:00100000:1.0:1788832934.550640:0:11720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788832934.550650:0:11720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994325120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832934.550689:0:11720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832934.550769:0:11720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994325120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832934.550776:0:11720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788832934.550862:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994325120:0@lo:13:osp-pre-0-0.0 00000020:00080000:2.0:1788832935.116937:0:5875:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1788832935.116967:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788832935.117129:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788832935.117140:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788832935.509880:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832936.534119:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788832936.931158:0:12838:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:02:15 (1788832935) 00010000:00010000:2.0:1788832937.559007:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832938.133907:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994325504:0@lo:400:kworker.0 00000100:00100000:2.0:1788832938.133971:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832938.134036:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832938.134043:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994325632:0@lo:400:kworker.0 00000100:00100000:2.0:1788832938.134068:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832938.134102:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994325504 00000100:00100000:2.0:1788832938.134109:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994325504 00000100:00100000:2.0:1788832938.134159:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788832938.134168:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994325504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832938.134216:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994325504:12345-0@lo:400:kworker.0 Request processed in 50us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832938.134223:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788832938.134255:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994325632 00000100:00100000:2.0:1788832938.134259:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994325632 00000100:00100000:2.0:1788832938.134285:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788832938.134293:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994325632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832938.134323:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994325632:12345-0@lo:400:kworker.0 Request processed in 31us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832938.134329:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788832938.134356:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832938.134360:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832938.134386:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994325632:0@lo:400:kworker.0 00000100:00100000:2.0:1788832938.134395:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994325504:0@lo:400:kworker.0 00000100:00100000:1.0:1788832938.134487:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994325248:0@lo:400:kworker.0 00000100:00100000:1.0:1788832938.134516:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832938.134535:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994325760:0@lo:400:kworker.0 00000100:00100000:1.0:1788832938.134552:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832938.134568:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788832938.134572:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994325376:0@lo:400:kworker.0 00000100:00100000:1.0:1788832938.134587:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832938.134599:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994325888:0@lo:400:kworker.0 00000100:00100000:1.0:1788832938.134614:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832938.134648:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994325760 00000100:00100000:1.0:1788832938.134651:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994325760 00000100:00100000:1.0:1788832938.134672:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994325376 00000100:00100000:1.0:1788832938.134674:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994325376 00000100:00100000:1.0:1788832938.134686:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788832938.134691:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994325760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832938.134721:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994325760:12345-0@lo:400:kworker.0 Request processed in 30us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832938.134727:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788832938.134737:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788832938.134763:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994325376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832938.134786:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994325376:12345-0@lo:400:kworker.0 Request processed in 44us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832938.134797:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788832938.134822:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994325376:0@lo:400:kworker.0 00000100:00100000:1.0:1788832938.134830:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994325760:0@lo:400:kworker.0 00000100:00100000:0.0:1788832938.134959:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994325248 00000100:00100000:0.0:1788832938.134963:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994325248 00000100:00100000:0.0:1788832938.134989:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788832938.134995:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994325248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832938.135031:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994325248:12345-0@lo:400:kworker.0 Request processed in 37us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832938.135037:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788832938.135059:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994325888 00000100:00100000:0.0:1788832938.135062:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994325888 00000100:00100000:0.0:1788832938.135081:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788832938.135086:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994325888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832938.135111:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994325888:12345-0@lo:400:kworker.0 Request processed in 25us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832938.135117:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788832938.135143:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994325888:0@lo:400:kworker.0 00000100:00100000:0.0:1788832938.135150:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994325248:0@lo:400:kworker.0 00000100:00100000:1.0:1788832938.135602:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1788832938.135642:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832938.135645:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832938.135735:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994326016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832938.135915:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832938.136584:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994326016 00000100:00100000:1.0:1788832938.136590:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994326016 00000100:00100000:1.0:1788832938.136739:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788832938.136788:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994326016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832938.136815:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832938.136860:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994326016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832938.136866:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788832938.136971:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994326016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832938.333792:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832938.333833:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832938.333859:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832938.333882:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832938.333901:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832938.333926:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975471488 00000100:00100000:2.0:1788832938.333934:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975471488 00000100:00100000:0.0:1788832938.333964:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975471872 00000100:00100000:0.0:1788832938.333971:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975471872 00000100:00100000:2.0:1788832938.333983:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 303 00000100:00100000:2.0:1788832938.333995:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975471488:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:0.0:1788832938.334024:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975471744 00000100:00100000:0.0:1788832938.334028:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975471744 00000100:00100000:0.0:1788832938.334056:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 86 00000100:00100000:0.0:1788832938.334065:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2359:x1875726975471872:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788832938.334089:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2359:x1875726975471488:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 94us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832938.334097:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 303 00000100:00100000:0.0:1788832938.334135:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2359:x1875726975471872:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 57us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832938.334143:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 87 00000100:00100000:3.0:1788832938.334200:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975471616 00000100:00100000:3.0:1788832938.334205:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975471616 00000100:00100000:3.0:1788832938.334236:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975472000 00000100:00100000:3.0:1788832938.334239:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975472000 00000100:00100000:3.0:1788832938.334257:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 169 00000100:00100000:3.0:1788832938.334263:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:2359:x1875726975471616:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832938.334294:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:2359:x1875726975471616:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 31us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832938.334300:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 169 00000100:00100000:3.0:1788832938.334313:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 170 00000100:00100000:3.0:1788832938.334318:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:2359:x1875726975472000:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832938.334351:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:2359:x1875726975472000:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 33us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832938.334358:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 170 00000100:00100000:2.0:1788832938.334634:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2359:x1875726975471744:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832938.334908:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2359:x1875726975471744:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 757us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832938.337040:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 86 00000100:00080000:2.0:1788832938.338846:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832938.338855:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832938.338858:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832938.339262:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 87 00010000:00010000:1.0:1788832938.586662:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832939.606954:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832939.670302:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994326144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832939.670371:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832939.670524:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994326144 00000100:00100000:1.0:1788832939.670534:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994326144 00000100:00100000:1.0:1788832939.670586:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788832939.670595:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994326144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832939.670627:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832939.670687:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994326144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832939.670694:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788832939.670914:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994326144:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788832940.119725:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788832940.119733:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788832940.120263:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788832940.120272:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788832940.629951:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832941.654041:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832942.058545:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832942.058649:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975472256 00000100:00100000:3.0:1788832942.058669:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975472256 00000100:00100000:3.0:1788832942.058729:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 66 00000100:00100000:3.0:1788832942.058740:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+18:12367:x1875726975472256:12345-192.168.206.41@tcp:35:umount.0 00000100:00080000:2.0:1788832942.058973:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832942.059350:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:12367:x1875726975472256:12345-192.168.206.41@tcp:35:umount.0 Request processed in 611us (813us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788832942.059359:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 66 00000100:00100000:0.0:1788832942.074059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832942.074776:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975472512 00000100:00100000:1.0:1788832942.074788:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975472512 00000100:00100000:1.0:1788832942.074864:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 67 00000100:00100000:1.0:1788832942.074874:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+19:12367:x1875726975472512:12345-192.168.206.41@tcp:35:umount.0 00000100:00100000:1.0:1788832942.075211:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:12367:x1875726975472512:12345-192.168.206.41@tcp:35:umount.0 Request processed in 338us (1160us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788832942.075219:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 67 00000100:00100000:2.0:1788832942.078246:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832942.078332:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975472768 00000100:00100000:1.0:1788832942.078341:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975472768 00000100:00100000:1.0:1788832942.078402:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 68 00000100:00100000:1.0:1788832942.078413:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d033dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+20:12367:x1875726975472768:12345-192.168.206.41@tcp:35:umount.0 00000100:00100000:1.0:1788832942.078675:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d033dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:12367:x1875726975472768:12345-192.168.206.41@tcp:35:umount.0 Request processed in 263us (436us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788832942.078683:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 68 00000100:00100000:2.0:1788832942.095131:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832942.096073:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975473024 00000100:00100000:3.0:1788832942.096085:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975473024 00000100:00100000:3.0:1788832942.096159:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 69 00000100:00100000:3.0:1788832942.096169:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:12367:x1875726975473024:12345-192.168.206.41@tcp:35:umount.0 00000100:00100000:3.0:1788832942.096673:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+22:12367:x1875726975473024:12345-192.168.206.41@tcp:35:umount.0 Request processed in 504us (1548us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788832942.096682:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 69 00000100:00100000:2.0:1788832942.113298:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832942.113348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832942.113376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832942.113468:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832942.113556:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975473408 00000100:00100000:0.0:1788832942.113565:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975473408 00000100:00100000:0.0:1788832942.113624:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 72 00000100:00100000:0.0:1788832942.113634:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+7:2356:x1875726975473408:12345-192.168.206.41@tcp:9:umount.0 00000020:00000080:0.0:1788832942.113662:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a50a4 00000020:00010000:0.0:1788832942.113669:0:6698:0:(genops.c:1921:obd_stale_export_put()) Put export ffff984d3a7b5000: total 0 00000100:00080000:0.0:1788832942.113674:0:6698:0:(import.c:65:import_set_state_nolock()) ffff984d3a7b7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788832942.113708:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788832942.113978:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2356:x1875726975473408:12345-192.168.206.41@tcp:9:umount.0 Request processed in 344us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832942.113986:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 72 00000020:00010000:0.0:1788832942.114012:0:5841:0:(genops.c:1907:obd_stale_export_get()) Get export ffff984d3a7b5000: total 0 00010000:00010000:0.0:1788832942.114031:0:5841:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff984d3a7b5000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788832942.114081:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a73406f/0xd270a10c1c6a5ade lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557a1 expref: 4 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832942.114112:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c46be351/0xd270a10c1c6a5440 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555d3 expref: 3 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832942.114125:0:5841:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff984d3a7b5000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788832942.114135:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832942.114137:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832942.114167:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788832942.114175:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832942.123303:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975473664 00000100:00100000:1.0:1788832942.123317:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975473664 00000100:00100000:1.0:1788832942.123387:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975473536 00000100:00100000:1.0:1788832942.123399:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975473536 00000100:00100000:1.0:1788832942.123415:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975473792 00000100:00100000:1.0:1788832942.123418:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975473792 00000100:00100000:1.0:1788832942.123437:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 19 00000100:00100000:1.0:1788832942.123445:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+15:2357:x1875726975473664:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832942.123459:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832942.123478:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e3000/0xd270a10c1c6a4aca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b552fb expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.123507:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832942.123568:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+14:2357:x1875726975473664:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 124us (10219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832942.123576:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 19 00000100:00100000:1.0:1788832942.123597:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 20 00000100:00100000:1.0:1788832942.123604:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+13:2357:x1875726975473536:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832942.123612:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832942.123621:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b702200/0xd270a10c1c6a4b64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55333 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.123630:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832942.123648:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:2357:x1875726975473536:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 45us (10272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832942.123654:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 20 00000100:00100000:1.0:1788832942.123667:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 21 00000100:00100000:1.0:1788832942.123673:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:2357:x1875726975473792:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832942.123679:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832942.123688:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3ada2a00/0xd270a10c1c6a4d4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553fe expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.123696:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832942.123713:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2357:x1875726975473792:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 40us (10245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832942.123718:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 21 00000100:00100000:1.0:1788832942.124817:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788832942.124939:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975473920 00000100:00100000:2.0:1788832942.124947:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975473920 00000100:00100000:2.0:1788832942.125016:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 73 00000100:00100000:2.0:1788832942.125027:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+5:2356:x1875726975473920:12345-192.168.206.41@tcp:9:umount.0 00000020:00000080:2.0:1788832942.125056:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4e3c 00000100:00080000:2.0:1788832942.125065:0:6700:0:(import.c:65:import_set_state_nolock()) ffff984d3a163800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788832942.125099:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:3.0:1788832942.125274:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832942.125738:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bee6676f-b533-4465-8162-bf8b5e1e90e6+2:2356:x1875726975473920:12345-192.168.206.41@tcp:9:umount.0 Request processed in 710us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832942.125787:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 73 00010000:00010000:2.0:1788832942.125809:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832942.144239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832942.144373:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975474944 00000100:00100000:3.0:1788832942.144383:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975474944 00000100:00100000:3.0:1788832942.144457:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 240 00000100:00100000:3.0:1788832942.144481:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+22:2356:x1875726975474944:12345-192.168.206.41@tcp:39:umount.0 00000020:00000080:3.0:1788832942.144513:0:7174:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4ad8 00000020:00010000:3.0:1788832942.144530:0:7174:0:(genops.c:1921:obd_stale_export_put()) Put export ffff984d3bdc9800: total 0 00000100:00080000:3.0:1788832942.144535:0:7174:0:(import.c:65:import_set_state_nolock()) ffff984d3bdce000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788832942.144561:0:7174:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1788832942.144965:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bee6676f-b533-4465-8162-bf8b5e1e90e6+21:2356:x1875726975474944:12345-192.168.206.41@tcp:39:umount.0 Request processed in 484us (733us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788832942.144973:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 240 00000020:00010000:1.0:1788832942.145407:0:7640:0:(genops.c:1907:obd_stale_export_get()) Get export ffff984d3bdc9800: total 0 00010000:00010000:1.0:1788832942.145452:0:7640:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff984d3bdc9800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788832942.145484:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:1.0:1788832942.145489:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788832942.145498:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a579d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b556c8 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.145516:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832942.145519:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832942.145523:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2000/0xd270a10c1c6a5321 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55586 expref: 19 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.145536:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:1.0:1788832942.145538:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788832942.145542:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a4e12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55428 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.145555:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:1.0:1788832942.145557:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832942.145561:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703400/0xd270a10c1c6a59bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55754 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.145572:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff984d02d42600) 00010000:00010000:1.0:1788832942.145574:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788832942.145577:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a50ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b554fa expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.145593:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff984d02d42f00) 00010000:00010000:1.0:1788832942.145604:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788832942.145609:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a54be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555f6 expref: 15 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.145629:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:1.0:1788832942.145631:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832942.145635:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb200/0xd270a10c1c6a54a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555ef expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.145645:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d02d42000) 00010000:00010000:1.0:1788832942.145648:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832942.145651:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04200/0xd270a10c1c6a4dbe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55413 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.145664:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832942.145667:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832942.145670:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703e00/0xd270a10c1c6a5401 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555be expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.145680:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:1.0:1788832942.145683:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832942.145686:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8c00/0xd270a10c1c6a5a9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5578c expref: 11 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.145696:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff984d02d42b00) 00010000:00010000:1.0:1788832942.145698:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788832942.145701:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b7d8600/0xd270a10c1c6a5ac9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5579a expref: 10 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.145730:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff984d02d42c00) 00010000:00010000:1.0:1788832942.145732:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832942.145736:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a4da2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5540c expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.145779:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff984d02d42500) 00010000:00010000:1.0:1788832942.145782:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788832942.145785:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a542b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b555cc expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832942.145797:0:7640:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff984d3bdc9800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788832942.145809:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832942.145812:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832942.145814:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832942.679079:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832943.255490:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994326400:0@lo:400:kworker.0 00000100:00100000:3.0:1788832943.255557:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832943.255625:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994326912:0@lo:400:kworker.0 00000100:00100000:3.0:1788832943.255661:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832943.255686:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788832943.255692:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994326272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832943.255713:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832943.255726:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994326784:0@lo:400:kworker.0 00000100:00100000:3.0:1788832943.255762:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832943.255785:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875726994326656:0@lo:400:kworker.0 00000100:00100000:3.0:1788832943.255805:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832943.255820:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788832943.255825:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994326528:0@lo:400:kworker.0 00000100:00100000:3.0:1788832943.255841:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832943.255854:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994327040:0@lo:400:kworker.0 00000100:00100000:3.0:1788832943.255869:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832943.255889:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994326912 00000100:00100000:3.0:1788832943.255906:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994326912 00000100:00100000:3.0:1788832943.255948:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994326656 00000100:00100000:3.0:1788832943.255951:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994326656 00000100:00100000:3.0:1788832943.255961:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994326528 00000100:00100000:3.0:1788832943.255963:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994326528 00000100:00100000:3.0:1788832943.255975:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788832943.255994:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994326912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832943.256038:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994326912:12345-0@lo:400:kworker.0 Request processed in 57us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832943.256045:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788832943.256060:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788832943.256065:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875726994326656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832943.256092:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875726994326656:12345-0@lo:400:kworker.0 Request processed in 27us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832943.256097:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788832943.256107:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788832943.256112:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994326528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832943.256132:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994326528:12345-0@lo:400:kworker.0 Request processed in 21us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832943.256138:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:3.0:1788832943.256157:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832943.256195:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994326528:0@lo:400:kworker.0 00000100:00100000:3.0:1788832943.256204:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875726994326656:0@lo:400:kworker.0 00000100:00100000:3.0:1788832943.256233:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994326912:0@lo:400:kworker.0 00000100:00100000:0.0:1788832943.256557:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994326784 00000100:00100000:0.0:1788832943.256571:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994326784 00000100:00100000:0.0:1788832943.256615:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994327040 00000100:00100000:0.0:1788832943.256619:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994327040 00000100:00100000:0.0:1788832943.256636:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788832943.256643:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994326784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832943.256690:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994326784:12345-0@lo:400:kworker.0 Request processed in 48us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832943.256696:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788832943.256709:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788832943.256714:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994327040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832943.256763:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994327040:12345-0@lo:400:kworker.0 Request processed in 27us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832943.256769:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788832943.256895:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994326400 00000100:00100000:1.0:1788832943.256900:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994326400 00000100:00100000:1.0:1788832943.256937:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788832943.256944:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d10379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994326400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832943.256977:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d10379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994326400:12345-0@lo:400:kworker.0 Request processed in 34us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832943.256995:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788832943.257026:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994326272 00000100:00100000:1.0:1788832943.257029:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994326272 00000100:00100000:1.0:1788832943.257050:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788832943.257057:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994326272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832943.257086:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788832943.257128:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994326272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832943.257134:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788832943.257734:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832943.257739:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832943.257803:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994327040:0@lo:400:kworker.0 00000100:00100000:3.0:1788832943.257839:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994326272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832943.257850:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994326784:0@lo:400:kworker.0 00000100:00100000:3.0:1788832943.257858:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994326400:0@lo:400:kworker.0 00000100:00100000:1.0:1788832943.454028:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832943.454080:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832943.454213:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975475200 00000100:00100000:0.0:1788832943.454227:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975475200 00000100:00100000:0.0:1788832943.454326:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 174 00000100:00100000:0.0:1788832943.454337:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:2359:x1875726975475200:12345-192.168.206.41@tcp:400:kworker.0 00000100:00080000:2.0:1788832943.454425:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832943.454459:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:2359:x1875726975475200:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 122us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832943.454468:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 174 00000100:00100000:3.0:1788832943.455287:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975475072 00000100:00100000:3.0:1788832943.455298:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975475072 00000100:00100000:3.0:1788832943.455364:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 305 00000100:00100000:3.0:1788832943.455374:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2359:x1875726975475072:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788832943.455511:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2359:x1875726975475072:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 137us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832943.455519:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 305 00010000:00010000:2.0:1788832943.712795:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832944.159177:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832944.159238:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788832944.159297:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832944.160355:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975475328 00000100:00100000:0.0:1788832944.160373:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975475328 00000100:00100000:0.0:1788832944.164974:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975475584 00000100:00100000:0.0:1788832944.164995:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975475584 00000100:00100000:0.0:1788832944.165265:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975475456 00000100:00100000:0.0:1788832944.165270:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975475456 00000100:00100000:0.0:1788832944.165297:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 22 00000100:00100000:0.0:1788832944.165308:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+12:2357:x1875726975475328:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832944.165328:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832944.165353:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d00030a00/0xd270a10c1c6a4baa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55348 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832944.165373:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832944.166518:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 23 00000100:00100000:2.0:1788832944.166540:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+11:2357:x1875726975475584:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832944.166556:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832944.166573:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3ada3000/0xd270a10c1c6a4d47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b553f7 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832944.166590:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832944.166677:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06e5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+10:2357:x1875726975475584:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 145us (7437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832944.166685:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 23 00000100:00100000:2.0:1788832944.166716:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 24 00000100:00100000:2.0:1788832944.166723:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+9:2357:x1875726975475456:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832944.166731:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832944.166740:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d00031c00/0xd270a10c1c6a4bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55372 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832944.166780:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832944.166806:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+8:2357:x1875726975475456:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 83us (7509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832944.166813:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 24 00000100:00100000:0.0:1788832944.167698:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+7:2357:x1875726975475328:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 2383us (8522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832944.167708:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 22 00000100:00100000:1.0:1788832944.173922:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788832944.174239:0:7174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975475840 00000100:00100000:3.0:1788832944.174252:0:7174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975475840 00000100:00100000:3.0:1788832944.174334:0:7174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 241 00000100:00100000:3.0:1788832944.174345:0:7174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+6:2356:x1875726975475840:12345-192.168.206.41@tcp:39:umount.0 00000020:00000080:3.0:1788832944.174416:0:7174:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4bbf 00000020:00010000:3.0:1788832944.174426:0:7174:0:(genops.c:1921:obd_stale_export_put()) Put export ffff984c070d9000: total 0 00000100:00080000:3.0:1788832944.174432:0:7174:0:(import.c:65:import_set_state_nolock()) ffff984c070de800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788832944.174464:0:7174:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788832944.175002:0:7174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54fb0a9d-642f-4015-b9e9-160fa4c59dd6+5:2356:x1875726975475840:12345-192.168.206.41@tcp:39:umount.0 Request processed in 655us (1091us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788832944.175012:0:7174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 241 00000020:00010000:1.0:1788832944.175260:0:7640:0:(genops.c:1907:obd_stale_export_get()) Get export ffff984c070d9000: total 0 00010000:00010000:1.0:1788832944.175265:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832944.175328:0:7640:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff984c070d9000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788832944.175368:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d03c60b00) 00010000:00010000:1.0:1788832944.175372:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832944.175392:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a5aec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557a8 expref: 4 pid: 7174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832944.175435:0:7640:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff984c070d9000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788832944.175446:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832944.175449:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832944.175450:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832944.201134:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788832944.201254:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975476096 00000100:00100000:0.0:1788832944.201273:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975476096 00000100:00100000:0.0:1788832944.201357:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 306 00000100:00100000:0.0:1788832944.201369:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d1037ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+7:2356:x1875726975476096:12345-192.168.206.41@tcp:251:umount.0 00000020:00000080:0.0:1788832944.201455:0:5847:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4ab5 00000020:00010000:0.0:1788832944.201465:0:5847:0:(genops.c:1921:obd_stale_export_put()) Put export ffff984c06633800: total 0 00000100:00080000:0.0:1788832944.201471:0:5847:0:(import.c:65:import_set_state_nolock()) ffff984c06630000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788832944.201572:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d1037ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:63388d3c-7517-4e8a-8a8f-97b1dbf6d67d+3:2356:x1875726975476096:12345-192.168.206.41@tcp:251:umount.0 Request processed in 204us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832944.201581:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 306 00000020:00010000:1.0:1788832944.201859:0:5841:0:(genops.c:1907:obd_stale_export_get()) Get export ffff984c06633800: total 0 00010000:00010000:1.0:1788832944.201915:0:5841:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff984c06633800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788832944.201956:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b703200/0xd270a10c1c6a4b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5533a expref: 2 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832944.201972:0:5841:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff984c06633800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788832944.201982:0:5841:0:(genops.c:885:class_export_put()) final put ffff984c06633800/63388d3c-7517-4e8a-8a8f-97b1dbf6d67d 00010000:00010000:1.0:1788832944.202019:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832944.202022:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832944.202024:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788832944.203148:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984c06633800/63388d3c-7517-4e8a-8a8f-97b1dbf6d67d for MGS 00000020:00000080:0.0:1788832944.203202:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984c06630000 for MGS 00010000:00010000:2.0:1788832944.726584:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832944.793970:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994327168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832944.794060:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832944.794175:0:11720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994327168 00000100:00100000:0.0:1788832944.794186:0:11720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994327168 00000100:00100000:0.0:1788832944.794257:0:11720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788832944.794270:0:11720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994327168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832944.794344:0:11720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788832944.794426:0:11720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994327168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832944.794433:0:11720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788832944.794632:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994327168:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788832945.360831:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:3.0:1788832945.360854:0:5875:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 54fb0a9d-642f-4015-b9e9-160fa4c59dd6 00000001:00080000:3.0:1788832945.360861:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788832945.360941:0:5875:0:(genops.c:885:class_export_put()) final put ffff984c070d9000/54fb0a9d-642f-4015-b9e9-160fa4c59dd6 00000001:00100000:3.0:1788832945.360964:0:5875:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bee6676f-b533-4465-8162-bf8b5e1e90e6 00000001:00080000:3.0:1788832945.360969:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788832945.360977:0:5875:0:(genops.c:885:class_export_put()) final put ffff984d3bdc9800/bee6676f-b533-4465-8162-bf8b5e1e90e6 00000020:00000080:1.0:1788832945.361447:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984c070d9000/54fb0a9d-642f-4015-b9e9-160fa4c59dd6 for lustre-MDT0000 00000020:00000080:1.0:1788832945.361529:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3bdc9800/bee6676f-b533-4465-8162-bf8b5e1e90e6 for lustre-MDT0000 00000020:00000080:1.0:1788832945.361563:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984c070de800 for lustre-MDT0000 00000020:00000080:1.0:1788832945.361569:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984d3bdce000 for lustre-MDT0000 00000001:00100000:3.0:1788832945.377921:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bee6676f-b533-4465-8162-bf8b5e1e90e6 00000020:00000080:3.0:1788832945.377944:0:7651:0:(genops.c:885:class_export_put()) final put ffff984d3a7b5000/bee6676f-b533-4465-8162-bf8b5e1e90e6 00000020:00000080:0.0:1788832945.378146:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3a7b5000/bee6676f-b533-4465-8162-bf8b5e1e90e6 for lustre-OST0001 00000020:00000080:0.0:1788832945.378205:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984d3a7b7800 for lustre-OST0001 00010000:00010000:1.0:1788832945.753274:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788832946.482713:0:13037:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788832946.512872:0:13037:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788832946.512919:0:13037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.512937:0:13037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.512945:0:13037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.512952:0:13037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.512979:0:13037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788832946.512986:0:13037:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788832946.513002:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1788832946.513013:0:13037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1788832946.513018:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832946.513020:0:13037:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788832946.513031:0:13037:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1788832946.513042:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d013d0600 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1788832946.513047:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832946.513059:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788832946.513069:0:13037:0:(import.c:65:import_set_state_nolock()) ffff984d3b1cd800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:1.0:1788832946.513069:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832946.513084:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788832946.513089:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788832946.513093:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1788832946.513116:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875726994327296:0@lo:39:umount.0 00010000:00010000:1.0:1788832946.513143:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832946.513153:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832946.513186:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832946.513196:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788832946.513216:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d013d0600/0xd270a10c1c6a4b3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4b41 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832946.513233:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832946.513236:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832946.513240:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832946.513253:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832946.513276:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994327424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832946.513343:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832946.513855:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994327424 00000100:00100000:3.0:1788832946.513863:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994327424 00000100:00100000:3.0:1788832946.513938:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788832946.513948:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32c45e-9a6a-4349-b87e-107522b34816+19:3317:x1875726994327424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788832946.513962:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832946.513981:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d00031800/0xd270a10c1c6a4b41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a4b3a expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.513997:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832946.514201:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32c45e-9a6a-4349-b87e-107522b34816+18:3317:x1875726994327424:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832946.514209:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788832946.514468:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994327296 00000100:00100000:0.0:1788832946.514480:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994327296 00000100:00100000:0.0:1788832946.514553:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788832946.514568:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875726994327296:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788832946.514601:0:5854:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a48c4 00000100:00080000:0.0:1788832946.514611:0:5854:0:(import.c:65:import_set_state_nolock()) ffff984d38bb5800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788832946.514707:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3313:x1875726994327296:12345-0@lo:39:umount.0 Request processed in 146us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832946.514717:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1788832946.514732:0:5854:0:(genops.c:885:class_export_put()) final put ffff984d38bb7000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1788832946.514848:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d3b1cd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788832946.514866:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875726994327296:0@lo:39:umount.0 00000100:00080000:3.0:1788832946.514903:0:13037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788832946.514907:0:13037:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788832946.514911:0:13037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788832946.515019:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788832946.515032:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d38bb7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788832946.515088:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984d38bb5800 for lustre-MDT0000 00000100:00100000:1.0:1788832946.517150:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994327424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788832946.521217:0:13037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521504:0:13037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521513:0:13037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521520:0:13037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521552:0:13037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788832946.521572:0:13037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521579:0:13037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521586:0:13037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521592:0:13037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521607:0:13037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788832946.521614:0:13037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521633:0:13037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521639:0:13037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521645:0:13037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521666:0:13037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788832946.521671:0:13037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e2800/0xd270a10c1c6a4823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521678:0:13037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e2800/0xd270a10c1c6a4823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521690:0:13037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d027e2800/0xd270a10c1c6a4823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521697:0:13037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.141@tcp lock: ffff984d027e2800/0xd270a10c1c6a4823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.521705:0:13037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788832946.521708:0:13037:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788832946.521732:0:13037:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788832946.521737:0:13037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788832946.521759:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832946.521775:0:13037:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788832946.521783:0:13037:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff984c0520a000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788832946.521789:0:13037:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff984c054c2000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788832946.521794:0:13037:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff984d06433370) has exports, disconnecting them 00000020:00080000:3.0:1788832946.521798:0:13037:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff984c0520a000), last request at 1788832943 00000020:00000080:3.0:1788832946.521806:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4a37 00000100:00080000:3.0:1788832946.521822:0:13037:0:(import.c:65:import_set_state_nolock()) ffff984c0520b800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788832946.521873:0:13037:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984c0520a000): rc 0 00000020:00000080:3.0:1788832946.521876:0:13037:0:(genops.c:885:class_export_put()) final put ffff984c0520a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788832946.521892:0:13037:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff984c054c2000), last request at 1788832943 00010000:00010000:0.0:1788832946.521894:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00000080:3.0:1788832946.521897:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a496c 00000100:00080000:3.0:1788832946.521906:0:13037:0:(import.c:65:import_set_state_nolock()) ffff984c054c6000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788832946.521912:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788832946.521917:0:13037:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984c054c2000): rc 0 00000020:00000080:3.0:1788832946.521925:0:13037:0:(genops.c:885:class_export_put()) final put ffff984c054c2000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1788832946.521940:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d013d0400 already unused, calling callback (ffffffffc1a5fc20) 00000004:00000080:3.0:1788832946.521943:0:13037:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae0441c93ae0 10000000:00010000:0.0:1788832946.521946:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.521964:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788832946.521967:0:13037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788832946.521981:0:13037:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 10000000:00010000:0.0:1788832946.521997:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832946.522005:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788832946.522008:0:5842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788832946.522017:0:5842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788832946.522073:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522081:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832946.522116:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522123:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d013d0400/0xd270a10c1c6a4b48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4b4f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522140:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788832946.522144:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522149:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d027e3400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788832946.522152:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522160:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832946.522167:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832946.522183:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788832946.522185:0:5842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788832946.522188:0:5842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788832946.522206:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522212:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832946.522237:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522244:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d027e3400/0xd270a10c1c6a4a6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522263:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788832946.522267:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522273:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702800 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788832946.522276:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522283:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832946.522289:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832946.522294:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788832946.522296:0:5842:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788832946.522298:0:5842:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788832946.522320:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522325:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832946.522331:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522337:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d3b702800/0xd270a10c1c6a4d71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4d78 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522346:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832946.522349:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d027e2800/0xd270a10c1c6a4823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522355:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d027e2800 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788832946.522357:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d027e2800/0xd270a10c1c6a4823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522363:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d027e2800/0xd270a10c1c6a4823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832946.522379:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d027e2800/0xd270a10c1c6a4823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832946.522384:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788832946.522386:0:5842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788832946.522388:0:5842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788832946.522402:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d027e2800/0xd270a10c1c6a4823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522407:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832946.522413:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d027e2800/0xd270a10c1c6a4823 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832946.522427:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994327680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832946.522430:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d027e2800/0xd270a10c1c6a4823 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a482a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.522453:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832946.522456:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832946.522459:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788832946.522474:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984c0520a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:2.0:1788832946.522508:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788832946.522537:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984c054c2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1788832946.522570:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832946.522583:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994327808:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788832946.522599:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984c0520b800 for lustre-MDT0000 00000100:00100000:2.0:1788832946.522607:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788832946.522612:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984c054c6000 for lustre-MDT0000 00000100:00100000:0.0:1788832946.522641:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994327936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832946.522652:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994327680 00000100:00100000:2.0:1788832946.522660:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994327680 00000100:00100000:2.0:1788832946.522713:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994327808 00000100:00100000:2.0:1788832946.522720:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994327808 00000100:00100000:0.0:1788832946.522722:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832946.522803:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832946.522810:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994327552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832946.522833:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832946.522867:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994327936 00000100:00100000:0.0:1788832946.522873:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994327936 00010000:00010000:1.0:1788832946.523013:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832946.523096:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832946.523681:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994327552 00000100:00100000:2.0:1788832946.523688:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994327552 00000100:00100000:2.0:1788832946.523725:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788832946.523773:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788832946.523791:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32c45e-9a6a-4349-b87e-107522b34816+21:3314:x1875726994327808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832946.523811:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832946.523933:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3ada3200/0xd270a10c1c6a4d78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a4d71 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.523952:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832946.524026:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32c45e-9a6a-4349-b87e-107522b34816+20:3314:x1875726994327808:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832946.524051:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788832946.524075:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788832946.524082:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32c45e-9a6a-4349-b87e-107522b34816+19:3316:x1875726994327936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832946.524091:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832946.524102:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e3a00/0xd270a10c1c6a482a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a4823 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.524118:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832946.524152:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32c45e-9a6a-4349-b87e-107522b34816+18:3316:x1875726994327936:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832946.524159:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788832946.524178:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788832946.524185:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32c45e-9a6a-4349-b87e-107522b34816+17:3316:x1875726994327552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832946.524193:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832946.524204:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d00031400/0xd270a10c1c6a4b4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a4b48 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832946.524214:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832946.524238:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32c45e-9a6a-4349-b87e-107522b34816+16:3316:x1875726994327552:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832946.524244:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788832946.524294:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994327808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832946.524331:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994327552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832946.524340:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994327936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832946.524688:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32c45e-9a6a-4349-b87e-107522b34816+15:3314:x1875726994327680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832946.524712:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832946.524734:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d0c00/0xd270a10c1c6a4a76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a4a6f expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832946.524854:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832946.524931:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32c45e-9a6a-4349-b87e-107522b34816+14:3314:x1875726994327680:12345-0@lo:103:ldlm_bl.0 Request processed in 1196us (2426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832946.524939:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1788832946.525036:0:13037:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788832946.525105:0:13037:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788832946.525128:0:13037:0:(import.c:65:import_set_state_nolock()) ffff984d3faa3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788832946.525147:0:13037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788832946.525151:0:13037:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788832946.525159:0:13037:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788832946.525231:0:13037:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788832946.525238:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994328064:0@lo:9:umount.0 00000100:00080000:3.0:1788832946.525244:0:13037:0:(import.c:65:import_set_state_nolock()) ffff984d38bb1000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788832946.525280:0:13037:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff984d06433370) has no exports 00000100:00100000:0.0:1788832946.525307:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832946.525347:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994328192:0@lo:9:umount.0 00000100:00100000:0.0:1788832946.525366:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832946.526041:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd32c45e-9a6a-4349-b87e-107522b34816:3314:1875726994327680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832946.526101:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994328064 00000100:00100000:1.0:1788832946.526107:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994328064 00000100:00100000:1.0:1788832946.526162:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994328192 00000100:00100000:1.0:1788832946.526166:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994328192 00000100:00100000:1.0:1788832946.526186:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788832946.526194:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875726994328064:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788832946.526216:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a49c7 00000100:00080000:1.0:1788832946.526404:0:6698:0:(import.c:65:import_set_state_nolock()) ffff984c054c1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788832946.526444:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788832946.526768:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788832946.526780:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875726994328192:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788832946.526799:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4aa0 00000100:00080000:3.0:1788832946.526806:0:6699:0:(import.c:65:import_set_state_nolock()) ffff984d3de76000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788832946.526833:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788832946.527098:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3313:x1875726994328192:12345-0@lo:9:umount.0 Request processed in 320us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832946.527106:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788832946.527451:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832946.527457:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788832946.527481:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788832946.527539:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d38bb1000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788832946.527549:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3313:x1875726994328064:12345-0@lo:9:umount.0 Request processed in 425us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832946.527560:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1788832946.527588:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788832946.527626:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788832946.527706:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788832946.527725:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994328192:0@lo:9:umount.0 00000100:00080000:0.0:1788832946.527780:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d3faa3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788832946.527794:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788832946.527796:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788832946.527799:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994328064:0@lo:9:umount.0 00000020:00080000:3.0:1788832946.542865:0:13037:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff984d06433370) has no exports 00000020:00000080:3.0:1788832946.680832:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a487e 00000020:00000080:3.0:1788832946.680849:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d39f19800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788832946.680875:0:13037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788832946.680965:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d39f19800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788832946.690525:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788832946.690546:0:13037:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788832946.690554:0:13037:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff984d10fb3370) has no exports 00000020:00000080:1.0:1788832946.691112:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4877 00000020:00000080:1.0:1788832946.691127:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d3de61800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788832946.691231:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788832946.691243:0:13037:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788832946.691246:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d3de62000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788832946.691249:0:13037:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3de62000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788832946.691255:0:13037:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788832946.693896:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3de61800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788832946.694958:0:13037:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984d3bc78ba0 - data ffff984d40ba8870/ffff984d3b2c5400 00000020:01000000:1.0:1788832946.695295:0:13037:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984d07d59360 - data ffff984d1714a798/ffff984d3b2bbc00 00000001:00000004:1.0:1788832946.710907:0:13037:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:3.0:1788832946.773891:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788832946.857856:0:13037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788832946.857865:0:13037:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788832946.857885:0:13037:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788832946.857888:0:13037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788832946.861279:0:7172:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788832946.861287:0:7172:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788832946.861299:0:7172:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788832946.863788:0:13037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788832946.863796:0:13037:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788832946.864248:0:13037:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788832946.864250:0:13037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788832946.866050:0:7728:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788832946.866056:0:7728:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788832946.866069:0:7728:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000001:00100000:0.0:1788832946.911274:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788832946.911284:0:6724:0:(genops.c:885:class_export_put()) final put ffff984c054c5800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788832946.911306:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bee6676f-b533-4465-8162-bf8b5e1e90e6 00000020:00000080:0.0:1788832946.911309:0:6724:0:(genops.c:885:class_export_put()) final put ffff984d3a166800/bee6676f-b533-4465-8162-bf8b5e1e90e6 00000020:00000080:0.0:1788832946.911323:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984c054c5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788832946.911364:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3a166800/bee6676f-b533-4465-8162-bf8b5e1e90e6 for lustre-OST0000 00000020:00000080:0.0:1788832946.911391:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984c054c1800 for lustre-OST0000 00000020:00000080:0.0:1788832946.911396:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984d3a163800 for lustre-OST0000 00000020:00000080:3.0:1788832946.978990:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4846 00000020:00000080:3.0:1788832946.979001:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d3bdcc000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788832946.979099:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3bdcc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788832946.989279:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a485b 00000020:00000080:0.0:1788832946.989295:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d3bdcd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788832946.989314:0:13037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788832946.989323:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788832946.989331:0:13037:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788832946.989336:0:13037:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff984d064319b8) has no exports 00000004:01000000:0.0:1788832946.989499:0:13037:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788832946.989507:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4a99 00000020:00000080:0.0:1788832946.989511:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d3bdc8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788832946.989515:0:13037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788832946.989518:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788832946.989524:0:13037:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788832946.989526:0:13037:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff984d06483370) has no exports 00000020:00000080:0.0:1788832946.989534:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4a92 00000020:00000080:0.0:1788832946.989537:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d38bb2800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788832946.989890:0:13037:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788832946.989895:0:13037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788832946.989900:0:13037:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788832946.989905:0:13037:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788832946.989907:0:13037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788832946.989934:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832946.989941:0:13037:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788832946.989946:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a49b2 00000020:00000080:0.0:1788832946.989951:0:13037:0:(genops.c:885:class_export_put()) final put ffff984c0520e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788832946.989954:0:13037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788832946.989958:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788832946.989961:0:13037:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788832946.989964:0:13037:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff984d06c34d28) has no exports 00000020:00000080:0.0:1788832946.989968:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a49ab 00000020:00000080:0.0:1788832946.989971:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d3faa6800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788832946.990279:0:13037:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788832946.990282:0:13037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788832946.990293:0:13037:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788832946.990297:0:13037:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788832946.990298:0:13037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788832946.990326:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832946.990331:0:13037:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788832946.990351:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832946.990354:0:13037:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788832946.990391:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4862 00000020:00000080:0.0:1788832946.990395:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d3bdc8800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788832946.990399:0:13037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788832946.990402:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788832946.990405:0:13037:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788832946.990407:0:13037:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff984d06430000) has no exports 00000020:00000080:0.0:1788832946.990425:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832946.990428:0:13037:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788832946.990431:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4869 00000020:00000080:0.0:1788832946.990434:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d3bdcf800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788832946.990441:0:13037:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984d2a26c800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788832946.990444:0:13037:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984d2a26c800 3 00000020:01000004:0.0:1788832946.990447:0:13037:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff984d2a26c800 from lustre-MDT0000 00000020:00000080:0.0:1788832946.990466:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832946.990469:0:13037:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788832946.990471:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d3bdc9000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788832946.990474:0:13037:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3bdc9000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788832946.990482:0:13037:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788832946.990543:0:13037:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788832946.990546:0:13037:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788832946.990549:0:13037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788832946.990551:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788832946.990554:0:13037:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788832946.990560:0:13037:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff984d0532e800 bd32c45e-9a6a-4349-b87e-107522b34816 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788832946.990565:0:13037:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff984d06c33370) has exports, disconnecting them 00000020:00080000:0.0:1788832946.990569:0:13037:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff984d0532e800), last request at 1788832720 00000020:00000080:0.0:1788832946.990588:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4807 00000020:00010000:0.0:1788832946.990591:0:13037:0:(genops.c:1921:obd_stale_export_put()) Put export ffff984d0532e800: total 7 00000100:00080000:0.0:1788832946.990596:0:13037:0:(import.c:65:import_set_state_nolock()) ffff984d0532a800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788832946.990617:0:13037:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984d0532e800): rc 0 00000020:00080000:0.0:1788832946.990621:0:13037:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff984d06c33370) has no exports 00000100:00100000:0.0:1788832946.990680:0:5846:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff984d08aad200:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1788832946.990808:0:5847:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff984d07009c00:5847] 1 exiting: rc = 0 00000020:00000080:1.0:1788832946.992277:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3bdcd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788832946.992289:0:36:0:(genops.c:885:class_export_put()) final put ffff984d0649a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788832946.992292:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984d0649a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788832946.992303:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788832946.992440:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3bdc8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788832946.992446:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984d38bb2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788832946.992452:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984d38bb1000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788832946.992457:0:36:0:(genops.c:885:class_export_put()) final put ffff984c054dc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788832946.992459:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984c054dc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788832946.992465:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788832946.992493:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984c0520e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788832946.992499:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3faa6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788832946.992516:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984d3faa3800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788832946.992521:0:36:0:(genops.c:885:class_export_put()) final put ffff984c054dd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788832946.992522:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984c054dd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788832946.992525:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788832946.992586:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3bdc8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788832946.992590:0:36:0:(genops.c:885:class_export_put()) final put ffff984d3bdcb800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788832946.992592:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3bdcb800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788832946.992595:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788832946.992765:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3bdcf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1788832946.994265:0:5842:0:(genops.c:1907:obd_stale_export_get()) Get export ffff984d0532e800: total 0 00010000:00010000:3.0:1788832946.994328:0:5842:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff984d0532e800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788832946.994360:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d00031000/0xd270a10c1c6a4b25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a4b1e expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.994391:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3ada3a00/0xd270a10c1c6a4b17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a4b10 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.994403:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d013d1000/0xd270a10c1c6a4b33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a4b2c expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.994416:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b702e00/0xd270a10c1c6a4d6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a4d63 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.994427:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d027e2200/0xd270a10c1c6a491f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a4918 expref: 5 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.994443:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3ada2e00/0xd270a10c1c6a4b5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a4b56 expref: 4 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.994453:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3ada3c00/0xd270a10c1c6a4d5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a4d55 expref: 3 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.994465:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d05f04e00/0xd270a10c1c6a4b09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd270a10c1c6a4b02 expref: 2 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832946.994476:0:5842:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff984d0532e800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788832946.994489:0:5842:0:(genops.c:885:class_export_put()) final put ffff984d0532e800/bd32c45e-9a6a-4349-b87e-107522b34816 00010000:00010000:3.0:1788832946.994512:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832946.994514:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832946.994516:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788832946.994533:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984d0532e800/bd32c45e-9a6a-4349-b87e-107522b34816 for MGS 00000100:00100000:3.0:1788832946.994551:0:5848:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff984d06411000:5848] 2 exiting: rc = 0 00000020:00000080:1.0:1788832946.994567:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984d0532a800 for MGS 00000100:00100000:0.0:1788832946.994639:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994648:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994655:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994663:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994668:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994674:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994679:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994685:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994690:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994697:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994702:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994708:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994713:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994718:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994724:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994729:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994735:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994740:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994778:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994784:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994789:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994805:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994812:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994817:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994823:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994828:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994833:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994847:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994852:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994857:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994863:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994869:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994875:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994880:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994886:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994891:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994900:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994905:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994911:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994916:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994921:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994935:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994941:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994946:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994953:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994959:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994966:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994972:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994976:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.994981:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995204:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995211:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995216:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995237:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995242:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995248:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995253:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995258:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995263:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995269:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995274:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995280:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995293:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832946.995298:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788832946.995850:0:13037:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788832946.995854:0:13037:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788832946.996829:0:13037:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984d3b6cd5a0 - data ffff984d40b58510/ffff984d3acdf400 00000020:01000000:0.0:1788832946.997105:0:13037:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984d07d59a20 - data ffff984d1734e5e8/ffff984d06402c00 00000020:00000080:0.0:1788832946.997724:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a47eb 00000020:00000080:0.0:1788832946.997732:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d06edd800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788832946.997896:0:13037:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984d2a26c800 from MGS, refs=2 00000020:01000004:0.0:1788832946.997899:0:13037:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984d2a26c800 2 00000020:01000004:0.0:1788832946.997902:0:13037:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff984d2a26c800 from MGS 00000020:00000080:0.0:1788832946.997921:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832946.997940:0:13037:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788832946.997943:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d22c90800/MGS 00000020:00000080:0.0:1788832946.997945:0:13037:0:(genops.c:844:class_export_destroy()) destroying export ffff984d22c90800/MGS for MGS 00000020:01000000:0.0:1788832946.997951:0:13037:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788832946.998000:0:13037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788832946.998005:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788832946.998009:0:13037:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788832946.998015:0:13037:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff984d3b1c9800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788832946.998021:0:13037:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff984d10fb0000) has exports, disconnecting them 00000020:00080000:0.0:1788832946.998025:0:13037:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff984d3b1c9800), last request at 1788832721 00000020:00000080:0.0:1788832946.998030:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a48b6 00000020:00080000:0.0:1788832946.998039:0:13037:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984d3b1c9800): rc 0 00000020:00000080:0.0:1788832946.998044:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d3b1c9800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788832947.000670:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d06edd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788832947.001051:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3b1c9800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788832947.011047:0:13037:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788832947.011056:0:13037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788832947.011060:0:13037:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788832947.011068:0:13037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788832947.011280:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788832947.011288:0:13037:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788832947.011294:0:13037:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984d2a26c800 1 00000020:00000080:1.0:1788832947.011300:0:13037:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a47dd 00000020:00000080:1.0:1788832947.011308:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d22c96800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788832947.011313:0:13037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788832947.011320:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788832947.011324:0:13037:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788832947.011327:0:13037:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff984d10fb19b8) has no exports 00000020:00000080:3.0:1788832947.011391:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984d3b1cd800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788832947.011398:0:8:0:(genops.c:885:class_export_put()) final put ffff984d3de65000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788832947.011401:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3de65000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788832947.011411:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788832947.011468:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d22c96800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788832947.110704:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788832947.110717:0:13037:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788832947.110723:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d0b7e0800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788832947.110738:0:13037:0:(genops.c:844:class_export_destroy()) destroying export ffff984d0b7e0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788832947.110783:0:13037:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788832947.110898:0:13037:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff984d0b7e7800 00000020:01000000:1.0:1788832947.111353:0:13037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788832947.111357:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788832947.111362:0:13037:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788832947.111375:0:13037:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff984d06484d28) has no exports 00000100:00100000:2.0:1788832947.113241:0:5855:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff984d18191800:5855] 2 exiting: rc = 0 00000100:00100000:0.0:1788832947.117089:0:5854:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff984d1034e800:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1788832947.117185:0:5853:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff984d18190400:5853] 0 exiting: rc = 1 00000100:00100000:3.0:1788832947.118338:0:7174:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff984d06d16e00:7174] 3 exiting: rc = 0 00000100:00100000:1.0:1788832947.118603:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118611:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118617:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118624:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118639:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118646:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118652:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118657:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118662:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118667:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118672:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118678:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118682:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118687:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118693:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118698:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118704:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118710:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118715:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118721:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118726:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118732:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118737:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118878:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118886:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118891:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118897:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118914:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118919:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118924:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118931:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118936:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118942:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118948:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118953:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118958:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118964:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118969:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118975:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118980:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118985:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.118994:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119000:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119006:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119011:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119016:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119021:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119028:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119034:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119039:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119047:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119054:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119060:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119066:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119073:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119080:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119089:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119193:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119199:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119204:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119209:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119214:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119227:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.119234:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832947.134446:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff984d071de400:5857] 1 exiting: rc = 0 00000100:00100000:3.0:1788832947.134557:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff984d18425200:5856] 0 exiting: rc = 1 00000100:00100000:1.0:1788832947.157194:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157209:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157216:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157222:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157227:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157232:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157239:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157245:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157250:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157256:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157262:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157268:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157275:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157280:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157285:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157290:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157295:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157300:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157305:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157310:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157315:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157320:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157326:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157330:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157335:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157340:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157345:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157350:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157355:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157360:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157376:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157382:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157388:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157404:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157409:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157414:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157419:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157424:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157429:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157434:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157439:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157444:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157449:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157454:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157459:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157464:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157469:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157474:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157479:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157484:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157489:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157493:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157498:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157503:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157509:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157514:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157519:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157523:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157528:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157534:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157538:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157543:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157548:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.157553:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.159850:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff984d071dfc00:5858] 0 exiting: rc = 1 00000100:00100000:3.0:1788832947.160925:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff984d071de600:5859] 1 exiting: rc = 0 00000100:00100000:1.0:1788832947.165332:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165343:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165349:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165384:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165390:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165396:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165405:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165431:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165443:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165454:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165484:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165492:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165499:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165509:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165516:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165523:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165531:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165539:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165547:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165555:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165562:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165571:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165604:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165613:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.165621:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166567:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166583:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166588:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166594:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166599:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166606:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166611:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166617:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166623:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166721:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166728:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166735:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166740:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166869:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166874:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166880:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166886:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166891:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166896:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166901:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166907:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166928:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166935:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166940:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166946:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166953:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166959:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166965:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166972:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166978:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166985:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166990:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.166996:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.167015:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.167022:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.167027:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.167033:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.167039:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.167054:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832947.179905:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff984d10fad200:5860] 0 exiting: rc = 1 00000100:00100000:1.0:1788832947.180034:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff984d10fac000:5861] 1 exiting: rc = 0 00000100:00100000:1.0:1788832947.180345:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180351:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180356:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180361:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180377:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180383:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180388:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180393:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180411:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180416:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180421:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180426:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180430:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180435:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180440:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180444:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180449:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180454:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180458:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180463:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180468:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180473:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180479:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180484:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180489:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180494:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180500:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180505:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180511:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180516:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180522:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180527:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180531:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180537:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180543:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180548:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180554:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180559:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180564:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180570:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180575:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180580:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180586:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180599:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180603:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180608:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180613:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180618:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180623:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180627:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180632:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180707:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180716:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180721:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180726:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180731:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180736:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180741:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180909:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180914:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180919:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180924:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180929:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.180934:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832947.182039:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff984d10fac800:5863] 1 exiting: rc = 0 00000100:00100000:2.0:1788832947.187444:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff984d06b23c00:5862] 0 exiting: rc = 1 00000100:00100000:1.0:1788832947.187564:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187572:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187579:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187586:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187591:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187597:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187604:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187610:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187616:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187623:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187950:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187959:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187964:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187968:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187982:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187987:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187992:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.187998:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188002:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188008:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188013:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188017:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188022:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188026:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188032:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188037:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188042:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188047:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188051:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188056:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188061:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188066:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188070:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188075:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188080:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188085:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188230:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188239:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188243:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188248:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188252:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188257:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188262:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188266:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188271:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188276:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188282:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188288:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188294:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188307:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188313:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188317:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188322:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188326:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188332:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188336:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188340:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188344:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188349:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188353:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188358:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188362:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188382:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.188389:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189109:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff984d0748ce00:5865] 1 exiting: rc = 0 00000100:00100000:0.0:1788832947.189265:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff984d0748c800:5864] 0 exiting: rc = 1 00000100:00100000:1.0:1788832947.189445:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189452:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189458:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189463:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189468:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189473:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189478:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189483:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189487:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189492:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189497:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189501:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189506:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189510:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189515:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189519:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189524:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189528:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189533:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189547:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189552:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189557:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189562:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189567:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189573:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189579:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189585:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189590:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189596:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189602:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189607:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189613:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189618:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189624:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189702:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189710:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189715:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189720:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189724:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189729:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189733:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.189738:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190272:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190280:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190285:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190290:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190295:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190300:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190304:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190309:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190314:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190320:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190324:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190329:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190343:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190348:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190353:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190358:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190363:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190377:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190382:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190386:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190392:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.190396:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.200432:0:5868:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff984d06456c00:5868] 2 exiting: rc = 0 00000100:00100000:3.0:1788832947.200679:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff984d06457a00:5866] 0 exiting: rc = 1 00000100:00100000:2.0:1788832947.206089:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff984d06457000:5867] 1 exiting: rc = 0 00000100:00100000:1.0:1788832947.206189:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206201:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206209:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206215:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206220:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206226:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206231:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206237:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206243:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206249:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206275:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206282:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206287:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206292:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206298:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206303:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206308:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206314:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206319:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206325:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206330:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206335:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206341:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206346:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206380:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206385:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206390:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206395:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206400:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206406:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206411:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206417:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206423:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206428:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206449:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206455:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206461:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206466:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206476:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206487:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206495:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206504:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206513:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206524:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206544:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206554:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206566:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206574:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206582:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206590:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206606:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206619:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206640:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206654:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206667:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206678:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206692:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206705:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206718:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.206740:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.207071:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.207077:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.207083:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832947.207089:0:13037:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788832947.213564:0:13037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788832947.213576:0:13037:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788832947.213581:0:13037:0:(genops.c:885:class_export_put()) final put ffff984d08b22000/MDS_uuid 00000020:00000080:1.0:1788832947.213585:0:13037:0:(genops.c:844:class_export_destroy()) destroying export ffff984d08b22000/MDS_uuid for MDS 00000020:01000000:1.0:1788832947.213594:0:13037:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788832947.214118:0:13037:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788832947.798560:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832948.380170:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832948.380187:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994328320:0@lo:400:kworker.0 00000400:00000100:0.0:1788832948.380238:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875726994328320 offset 0 length 224: 4 00000100:00100000:3.0:1788832948.380372:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994328576:0@lo:400:kworker.0 00000400:00000100:3.0:1788832948.380398:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726994328576 offset 0 length 224: 4 00000100:00100000:2.0:1788832948.380462:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994328448:0@lo:400:kworker.0 00000400:00000100:3.0:1788832948.380541:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726994328448 offset 0 length 224: 4 00010000:00010000:1.0:1788832948.823845:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832949.845940:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788832950.289480:0:13188:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788832950.306702:0:13188:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788832950.306769:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832950.306784:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832950.306791:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832950.306797:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832950.306818:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788832950.306823:0:13188:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788832950.306846:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788832950.306856:0:13188:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984d3ace4e00 x1875726994328448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832964 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832950.306874:0:13188:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788832950.306892:0:13188:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788832950.307033:0:13188:0:(import.c:65:import_set_state_nolock()) ffff984c054de800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788832950.307097:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832950.307105:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832950.307112:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d013d1e00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1788832950.307115:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832950.307124:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832950.307143:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832950.307149:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788832950.307151:0:7640:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788832950.307153:0:7640:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788832950.307177:0:7640:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832950.307184:0:7640:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832950.307212:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832950.307219:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d013d1e00/0xd270a10c1c6a4b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd270a10c1c6a4b25 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832950.307231:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832950.307233:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832950.307235:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832950.307243:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788832950.307257:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994328832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788832950.307319:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832950.307392:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994328832 00000100:00100000:3.0:1788832950.307398:0:7639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994328832 00000100:00100000:3.0:1788832950.307430:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788832950.307437:0:7639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3317:x1875726994328832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788832950.307443:0:7639:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788832950 with bad export cookie 15163797018744866823 00000100:00100000:0.0:1788832950.307793:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994328448:0@lo:400:kworker.0 00000100:00100000:0.0:1788832950.307819:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875726994328704:0@lo:39:umount.0 00000400:00000100:0.0:1788832950.307841:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726994328704 offset 0 length 224: 4 00000100:00100000:3.0:1788832950.315416:0:7639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3317:x1875726994328832:12345-0@lo:103:ldlm_bl.0 Request processed in 7969us (8089us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788832950.315442:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788832950.315545:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788832950.315550:0:3317:0:(import.c:65:import_set_state_nolock()) ffff984d18126000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788832950.315554:0:3317:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.141@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788832950.322182:0:3317:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.141@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788832950.322188:0:3317:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788832950.322196:0:3317:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984d3ace6300 x1875726994328320/t0(0) o400->MGC192.168.206.141@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788832964 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832950.322264:0:3317:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984d3aa3d180 x1875726994328832/t0(0) o103->MGC192.168.206.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788832966 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788832950.322273:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788832950.322276:0:3317:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788832950.322277:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788832950.322281:0:3317:0:(import.c:65:import_set_state_nolock()) ffff984d18126000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832950.322285:0:3317:0:(import.c:510:import_select_connection()) MGC192.168.206.141@tcp: connect to NID 0@lo last attempt 224 00000100:00080000:0.0:1788832950.322293:0:3317:0:(import.c:624:import_select_connection()) MGC192.168.206.141@tcp: import ffff984d18126000 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:0.0:1788832950.322363:0:3317:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984c04ba7b80 x1875726994328960/t0(0) o250->MGC192.168.206.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788832950.322408:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd32c45e-9a6a-4349-b87e-107522b34816:3317:1875726994328832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832950.322471:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd32c45e-9a6a-4349-b87e-107522b34816:3313:1875726994328960:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1788832950.322519:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875726994328960 offset 0 length 520: 4 00000100:00100000:1.0:1788832950.322600:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd32c45e-9a6a-4349-b87e-107522b34816:3316:1875726994328320:0@lo:400:kworker.0 00000001:00100000:3.0:1788832950.471178:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788832950.471189:0:7651:0:(genops.c:885:class_export_put()) final put ffff984d3de72000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788832950.471495:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3de72000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788832950.471542:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984d3de76000 for lustre-OST0001 00010000:00010000:1.0:1788832950.871738:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832951.893872:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832952.919186:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788832953.494511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd32c45e-9a6a-4349-b87e-107522b34816->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788832953.494520:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd32c45e-9a6a-4349-b87e-107522b34816->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788832953.494643:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994329088:0@lo:400:kworker.0 00000400:00000100:0.0:1788832953.494695:0:3317:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726994329088 offset 0 length 224: 4 00010000:00010000:1.0:1788832953.941944:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788832954.517946:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd32c45e-9a6a-4349-b87e-107522b34816->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788832954.517955:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd32c45e-9a6a-4349-b87e-107522b34816->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788832954.518096:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788832954.518115:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994329216:0@lo:400:kworker.0 00000400:00000100:3.0:1788832954.518166:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726994329216 offset 0 length 224: 4 00010000:00010000:3.0:1788832954.965889:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832955.989877:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832957.013953:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832958.037882:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832959.061883:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788832959.638396:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd32c45e-9a6a-4349-b87e-107522b34816->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788832959.638406:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd32c45e-9a6a-4349-b87e-107522b34816->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788832959.639833:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832959.639860:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994329344:0@lo:400:kworker.0 00000400:00000100:0.0:1788832959.639926:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726994329344 offset 0 length 224: 4 00010000:00010000:1.0:1788832960.086412:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832960.662795:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832950/real 1788832950] req@ffff984c04ba7b80 x1875726994328960/t0(0) o250->MGC192.168.206.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788832960 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832960.662824:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984c04ba7b80 x1875726994328960/t0(0) o250->MGC192.168.206.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788832960 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832960.662834:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832950/real 1788832950] req@ffff984d3b37f100 x1875726994328704/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788832960 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832960.662847:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984d3b37f100 x1875726994328704/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788832960 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788832960.662859:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d18126000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788832960.662868:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788832960.662871:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd32c45e-9a6a-4349-b87e-107522b34816:3313:1875726994328960:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1788832960.662877:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984c054de800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788832960.662936:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875726994328704:0@lo:39:umount.0 00000100:00080000:3.0:1788832960.663018:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd32c45e-9a6a-4349-b87e-107522b34816->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788832960.663023:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788832960.663026:0:36:0:(import.c:65:import_set_state_nolock()) ffff984d18126000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788832960.663030:0:36:0:(import.c:510:import_select_connection()) MGC192.168.206.141@tcp: connect to NID 0@lo last attempt 454 00000100:00080000:3.0:1788832960.663034:0:36:0:(import.c:589:import_select_connection()) MGC192.168.206.141@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788832960.663040:0:36:0:(import.c:624:import_select_connection()) MGC192.168.206.141@tcp: import ffff984d18126000 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:3.0:1788832960.663065:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984d3aa3ca80 x1875726994329472/t0(0) o250->MGC192.168.206.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788832960.663162:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994329600:0@lo:400:kworker.0 00000400:00000100:2.0:1788832960.663203:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726994329600 offset 0 length 224: 4 00000100:00100000:0.0:1788832960.663472:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd32c45e-9a6a-4349-b87e-107522b34816:3313:1875726994329472:0@lo:250:kworker.0 00000400:00000100:0.0:1788832960.663494:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875726994329472 offset 0 length 520: 4 00000100:00080000:1.0:1788832960.667396:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788832960.667405:0:13188:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788832960.667610:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788832960.669211:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832960.669229:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832960.669236:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832960.669243:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832960.669338:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788832960.669357:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832960.669365:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832960.669371:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832960.669377:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832960.669400:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788832960.669404:0:13188:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1788832960.669450:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788832960.669457:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832960.669464:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05c00 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1788832960.669467:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832960.669486:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832960.669493:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832960.669499:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788832960.669501:0:5842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788832960.669504:0:5842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788832960.669516:0:5842:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984d18126000 00010000:00010000:3.0:1788832960.669520:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832960.669526:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d05f05c00/0xd270a10c1c6a4b2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd270a10c1c6a4b33 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832960.669540:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832960.669543:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832960.669549:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207e000 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1788832960.669551:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832960.669557:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832960.669573:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832960.669589:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788832960.669591:0:5842:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788832960.669593:0:5842:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788832960.669600:0:5842:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984d18126000 00010000:00010000:3.0:1788832960.669603:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832960.669608:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d4207e000/0xd270a10c1c6a4d63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd270a10c1c6a4d6a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832960.669622:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832960.669624:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832960.669625:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788832960.669914:0:13188:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788832960.669919:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788832960.669923:0:13188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788832960.669928:0:13188:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788832960.669933:0:13188:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff984d20340000) has no exports 00000020:00080000:1.0:1788832960.669957:0:13188:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff984d20340000) has no exports 00010000:00010000:0.0:1788832960.670496:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788832960.677608:0:13188:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984d070611e0 - data ffff984d40bf6000/ffff984c050fac00 00000020:01000000:1.0:1788832960.678006:0:13188:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984d02c41ae0 - data ffff984d30b41000/ffff984d3de9cc00 00100000:10000000:1.0:1788832960.697357:0:13188:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788832960.722094:0:13188:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a493b 00000020:00000080:3.0:1788832960.722112:0:13188:0:(genops.c:885:class_export_put()) final put ffff984d3b1c8800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788832960.722141:0:13188:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984d39f1a000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788832960.722145:0:13188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984d39f1a000 2 00000020:01000004:3.0:1788832960.722149:0:13188:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff984d39f1a000 from lustre-OST0000 00000020:00000080:3.0:1788832960.722182:0:13188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832960.722193:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788832960.722196:0:13188:0:(genops.c:885:class_export_put()) final put ffff984d3bdca000/lustre-OST0000_UUID 00000020:00000080:3.0:1788832960.722199:0:13188:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3bdca000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788832960.722208:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788832960.722268:0:13188:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788832960.722273:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788832960.722277:0:13188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832960.722281:0:13188:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788832960.722288:0:13188:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff984c054db000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788832960.722293:0:13188:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff984d06c30000) has exports, disconnecting them 00000020:00080000:3.0:1788832960.722319:0:13188:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff984c054db000), last request at 1788832736 00000020:00000080:3.0:1788832960.722324:0:13188:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4965 00000020:00080000:3.0:1788832960.722337:0:13188:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984c054db000): rc 0 00000020:00000080:3.0:1788832960.722343:0:13188:0:(genops.c:885:class_export_put()) final put ffff984c054db000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788832960.722650:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3b1c8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788832960.722671:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984c054db000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788832960.724802:0:13188:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788832960.724809:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788832960.724813:0:13188:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788832960.724820:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788832960.724980:0:13188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788832960.724987:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788832960.724993:0:13188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984d39f1a000 1 00000020:00000080:2.0:1788832960.724999:0:13188:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a48f5 00000020:00000080:2.0:1788832960.725007:0:13188:0:(genops.c:885:class_export_put()) final put ffff984d38bb0800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788832960.725011:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788832960.725016:0:13188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788832960.725020:0:13188:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788832960.725023:0:13188:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff984d20343370) has no exports 00000020:00000080:0.0:1788832960.725622:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984c054de800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788832960.725630:0:8:0:(genops.c:885:class_export_put()) final put ffff984d3faa2000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788832960.725633:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3faa2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788832960.725640:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788832960.725688:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d38bb0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788832960.747016:0:13188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832960.747031:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788832960.747037:0:13188:0:(genops.c:885:class_export_put()) final put ffff984d39f18000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788832960.747041:0:13188:0:(genops.c:844:class_export_destroy()) destroying export ffff984d39f18000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788832960.747051:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788832960.747177:0:13188:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff984d39f1e800 00000020:02000400:0.0:1788832960.747218:0:13188:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788832961.109978:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832962.133831:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832963.159661:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788832963.293663:0:13341:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788832963.307000:0:13341:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788832963.307069:0:13341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832963.307083:0:13341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832963.307105:0:13341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832963.307112:0:13341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832963.307135:0:13341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788832963.307141:0:13341:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788832963.307159:0:13341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788832963.307170:0:13341:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984d3ace7100 x1875726994328576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832964 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832963.307196:0:13341:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984d3b37d180 x1875726994329088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832969 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832963.307208:0:13341:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984d3b37d880 x1875726994329216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832970 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832963.307216:0:13341:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984d3ace5180 x1875726994329344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832975 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832963.307231:0:13341:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984d3aa3d180 x1875726994329600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832976 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832963.307241:0:13341:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788832963.307247:0:13341:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788832963.307269:0:13341:0:(import.c:65:import_set_state_nolock()) ffff984c06633000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788832963.307535:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832963.307551:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832963.307560:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2800 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788832963.307563:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832963.307572:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832963.307579:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832963.307585:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788832963.307587:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788832963.307596:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788832963.307609:0:5841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984d18126000 00010000:00010000:2.0:1788832963.307613:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832963.307620:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a4b02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd270a10c1c6a4b09 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832963.307630:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832963.307632:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832963.307634:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832963.307659:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994329600:0@lo:400:kworker.0 00000100:00100000:0.0:1788832963.307791:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994329216:0@lo:400:kworker.0 00000100:00100000:0.0:1788832963.307799:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875726994328576:0@lo:400:kworker.0 00000100:00100000:0.0:1788832963.307827:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994329088:0@lo:400:kworker.0 00000100:00100000:0.0:1788832963.307847:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875726994329728:0@lo:39:umount.0 00000400:00000100:0.0:1788832963.307889:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726994329728 offset 0 length 224: 4 00000100:00100000:0.0:1788832963.308368:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994329344:0@lo:400:kworker.0 00010000:00010000:3.0:1788832964.181885:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832965.208441:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788832965.783153:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd32c45e-9a6a-4349-b87e-107522b34816->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788832965.783162:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd32c45e-9a6a-4349-b87e-107522b34816->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788832966.231631:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832967.253914:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832968.278157:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832969.301959:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832970.325895:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788832970.902729:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd32c45e-9a6a-4349-b87e-107522b34816->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788832970.902738:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd32c45e-9a6a-4349-b87e-107522b34816->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788832971.352055:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832972.373987:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832973.398773:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832973.529761:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832963/real 1788832963] req@ffff984d3b37f480 x1875726994329728/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788832973 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832973.529804:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984d3b37f480 x1875726994329728/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788832973 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788832973.529823:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984c06633000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788832973.529843:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875726994329728:0@lo:39:umount.0 00000100:00080000:1.0:1788832973.530322:0:13341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788832973.530339:0:13341:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788832973.530343:0:13341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788832973.531456:0:13341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832973.531471:0:13341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832973.531479:0:13341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832973.531485:0:13341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832973.531508:0:13341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788832973.531515:0:13341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832973.531523:0:13341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832973.531529:0:13341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832973.531534:0:13341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832973.531906:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832973.531914:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832973.531921:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d013d0800 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788832973.531925:0:7640:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832973.531933:0:7640:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832973.531941:0:7640:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832973.531956:0:7640:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788832973.531959:0:7640:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1788832973.531970:0:7640:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984d18126000 00010000:00010000:2.0:1788832973.531974:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832973.531980:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d013d0800/0xd270a10c1c6a4b10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd270a10c1c6a4b17 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832973.531994:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832973.531995:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832973.531997:0:7640:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832973.535647:0:13341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788832973.535657:0:13341:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788832973.535664:0:13341:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788832973.535689:0:13341:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788832973.535705:0:13341:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788832973.535710:0:13341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788832973.535715:0:13341:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788832973.535719:0:13341:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff984d20344d28) has no exports 00000020:00080000:1.0:1788832973.535763:0:13341:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff984d20344d28) has no exports 00000020:01000000:1.0:1788832973.543923:0:13341:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984d07061a80 - data ffff984d40bf6af8/ffff984d3d5eb000 00000020:01000000:1.0:1788832973.544054:0:13341:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff984d10e84d80 - data ffff984d30bca5e8/ffff984d39f21c00 00010000:00010000:2.0:1788832973.544450:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832973.544460:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832973.544471:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05000 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788832973.544476:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832973.544486:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832973.544493:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832973.544498:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788832973.544501:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788832973.544504:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788832973.544535:0:5841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984d18126000 00010000:00010000:2.0:1788832973.544547:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832973.544554:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d05f05000/0xd270a10c1c6a4d55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd270a10c1c6a4d5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832973.544572:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832973.544574:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832973.544576:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788832973.568395:0:13341:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788832973.618443:0:13341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4a06 00000020:00000080:3.0:1788832973.618453:0:13341:0:(genops.c:885:class_export_put()) final put ffff984d07510800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788832973.618473:0:13341:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984d07487000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788832973.618477:0:13341:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984d07487000 2 00000020:01000004:3.0:1788832973.618480:0:13341:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff984d07487000 from lustre-OST0001 00000020:00000080:3.0:1788832973.618515:0:13341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832973.618525:0:13341:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788832973.618528:0:13341:0:(genops.c:885:class_export_put()) final put ffff984c054b0800/lustre-OST0001_UUID 00000020:00000080:3.0:1788832973.618531:0:13341:0:(genops.c:844:class_export_destroy()) destroying export ffff984c054b0800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788832973.618537:0:13341:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1788832973.618600:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d07510800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1788832973.618613:0:13341:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import bd32c45e-9a6a-4349-b87e-107522b34816->MGS 00010000:00010000:3.0:1788832973.618627:0:13341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a4918 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd270a10c1c6a491f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832973.618639:0:13341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a4918 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd270a10c1c6a491f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832973.618646:0:13341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788832973.618649:0:13341:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788832973.618652:0:13341:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788832973.618664:0:13341:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984d18126000 00010000:00010000:3.0:1788832973.618668:0:13341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d00031600/0xd270a10c1c6a4918 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd270a10c1c6a491f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832973.618708:0:13341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd270a10c1c6a4b5d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832973.618715:0:13341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd270a10c1c6a4b5d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832973.618721:0:13341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788832973.618723:0:13341:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788832973.618725:0:13341:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788832973.618950:0:13341:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff984d18126000 00010000:00010000:3.0:1788832973.618954:0:13341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d00030c00/0xd270a10c1c6a4b56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd270a10c1c6a4b5d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788832973.618983:0:13341:0:(import.c:65:import_set_state_nolock()) ffff984d18126000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788832973.618987:0:13341:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788832973.618989:0:13341:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788832973.618990:0:13341:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788832973.618994:0:13341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788832973.619004:0:13341:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff984d3aa3ca80 x1875726994329472/t0(0) o250->MGC192.168.206.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788832975 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788832973.619023:0:13341:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788832973.619026:0:13341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1788832973.619291:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd32c45e-9a6a-4349-b87e-107522b34816:3313:1875726994329472:0@lo:250:kworker.0 10000000:01000000:3.0:1788832973.621635:0:13341:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788832973.621655:0:13341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a47f9 00000020:00000080:3.0:1788832973.621665:0:13341:0:(genops.c:885:class_export_put()) final put ffff984d08b22800/bd32c45e-9a6a-4349-b87e-107522b34816 00000020:01000000:3.0:1788832973.621699:0:13341:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.141@tcp (flags='') 00000020:00000080:3.0:1788832973.621709:0:13341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832973.621718:0:13341:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.141@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788832973.621722:0:13341:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff984d06434d28) has no exports 00000020:00000080:0.0:1788832973.621765:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d08b22800/bd32c45e-9a6a-4349-b87e-107522b34816 for MGC192.168.206.141@tcp 10000000:01000000:0.0:1788832973.623284:0:5850:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788832973.623382:0:13341:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.141@tcp: client import never connected 00000100:00080000:3.0:1788832973.623396:0:13341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788832973.623399:0:13341:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788832973.623403:0:13341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788832973.623405:0:13341:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788832973.623456:0:13341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832973.623464:0:13341:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.141@tcp (uuid bd32c45e-9a6a-4349-b87e-107522b34816) 00000020:01000000:3.0:1788832973.623471:0:13341:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788832973.623475:0:13341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832973.623479:0:13341:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788832973.623487:0:13341:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff984c06634800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788832973.623493:0:13341:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff984d10fb4d28) has exports, disconnecting them 00000020:00080000:3.0:1788832973.623497:0:13341:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff984c06634800), last request at 1788832751 00000020:00000080:3.0:1788832973.623502:0:13341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a4a30 00000020:00080000:3.0:1788832973.623515:0:13341:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff984c06634800): rc 0 00000020:00000080:3.0:1788832973.623520:0:13341:0:(genops.c:885:class_export_put()) final put ffff984c06634800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788832973.624387:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984d18126000 for MGC192.168.206.141@tcp 00000020:00000080:0.0:1788832973.624395:0:8:0:(genops.c:885:class_export_put()) final put ffff984d18123800/bd32c45e-9a6a-4349-b87e-107522b34816 00000020:00000080:0.0:1788832973.624398:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d18123800/bd32c45e-9a6a-4349-b87e-107522b34816 for MGC192.168.206.141@tcp 00000020:01000000:0.0:1788832973.624404:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.141@tcp (bd32c45e-9a6a-4349-b87e-107522b34816) 00000020:00000080:0.0:1788832973.624626:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984c06634800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788832973.624853:0:13341:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788832973.624857:0:13341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788832973.624861:0:13341:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788832973.624866:0:13341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788832973.624945:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff984c06633000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788832973.628954:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788832973.691787:0:7640:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788832973.691905:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788832973.692002:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff984d03692a00:5836] 0 exiting: rc = 1 00000100:00100000:2.0:1788832973.692606:0:5837:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff984d03692e00:5837] 1 exiting: rc = 0 00000100:00100000:1.0:1788832973.692782:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.693020:0:5838:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff984d29b25800:5838] 0 exiting: rc = 1 00000100:00100000:3.0:1788832973.694824:0:5839:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff984d29b25600:5839] 1 exiting: rc = 0 00000100:00100000:3.0:1788832973.694907:0:7639:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff984d10ee1600:7639] 3 exiting: rc = 0 00000100:00100000:3.0:1788832973.695927:0:5840:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff984d29b24200:5840] 2 exiting: rc = 0 00000100:00100000:1.0:1788832973.695993:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696001:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696008:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696014:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696019:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696025:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696031:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696037:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696043:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696049:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696054:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696059:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696065:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696070:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696075:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696082:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696088:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696093:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696098:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696103:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696107:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696112:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696118:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696123:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696144:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696149:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696153:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696158:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696163:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696167:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696172:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696177:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696182:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696187:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696192:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696197:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696202:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696207:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696212:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696216:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696221:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696225:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696241:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696247:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696253:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696257:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696262:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696267:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696272:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696277:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696282:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696287:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696292:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696297:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696302:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696306:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696312:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696317:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696322:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696335:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696341:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696345:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696350:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832973.696355:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788832973.697083:0:13341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788832973.697092:0:13341:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788832973.697097:0:13341:0:(genops.c:885:class_export_put()) final put ffff984d3b918000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788832973.697101:0:13341:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3b918000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788832973.697106:0:13341:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788832973.697143:0:13341:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984d07487000 1 00000020:00000080:1.0:1788832973.697148:0:13341:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd270a10c1c6a49d5 00000020:00000080:1.0:1788832973.697154:0:13341:0:(genops.c:885:class_export_put()) final put ffff984d3b91b800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788832973.697171:0:13341:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788832973.697175:0:13341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788832973.697179:0:13341:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788832973.697182:0:13341:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff984d06c319b8) has no exports 00000020:00000080:0.0:1788832973.697255:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff984d3b91b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788832973.721358:0:13341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788832973.721377:0:13341:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788832973.721383:0:13341:0:(genops.c:885:class_export_put()) final put ffff984d07482800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788832973.721387:0:13341:0:(genops.c:844:class_export_destroy()) destroying export ffff984d07482800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788832973.721398:0:13341:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788832973.722760:0:13341:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff984d07481800 00000020:01000000:2.0:1788832973.722784:0:13341:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788832973.722789:0:13341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788832973.722794:0:13341:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788832973.722798:0:13341:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff984d064819b8) has no exports 00000020:00000080:2.0:1788832973.722820:0:13341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788832973.722827:0:13341:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788832973.722830:0:13341:0:(genops.c:885:class_export_put()) final put ffff984d38bb4800/OSS_uuid 00000020:00000080:2.0:1788832973.722833:0:13341:0:(genops.c:844:class_export_destroy()) destroying export ffff984d38bb4800/OSS_uuid for OSS 00000020:01000000:2.0:1788832973.722838:0:13341:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788832973.723812:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff984d06c59e00:6700] 2 exiting: rc = 0 00000100:00100000:1.0:1788832973.723951:0:8475:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff984d3b9b0e00:8475] 3 exiting: rc = 0 00000100:00100000:1.0:1788832973.724020:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff984d06c58c00:6698] 0 exiting: rc = 1 00000100:00080000:0.0:1788832973.724121:0:5849:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788832973.724826:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff984d06c58000:6699] 1 exiting: rc = 0 00000100:00100000:2.0:1788832973.725137:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725159:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725171:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725181:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725191:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725209:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725219:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725226:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725249:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725323:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725332:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725341:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725349:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725359:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725368:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725377:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725387:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725396:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725402:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725407:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725424:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725430:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725435:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725440:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725445:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725554:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725562:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725566:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725571:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725576:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725580:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725585:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725590:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725595:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.725599:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726681:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726698:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726708:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726717:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726722:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726738:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726845:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726854:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726864:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726872:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726881:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726888:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726896:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726906:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726915:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726924:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726935:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726943:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726950:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726956:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726962:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.726968:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.727202:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.727210:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.727215:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.727221:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.727226:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.727247:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.727253:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832973.729124:0:11720:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff984d3b9a7400:11720] 2 exiting: rc = 0 00000100:00100000:2.0:1788832973.729142:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff984d06b9a400:6703] 1 exiting: rc = 0 00000100:00100000:1.0:1788832973.729292:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff984d06ef9400:6701] 0 exiting: rc = 1 00000100:00100000:3.0:1788832973.729587:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729596:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729602:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729608:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729613:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729618:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729623:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729628:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729634:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729639:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729644:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729650:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729666:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729683:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729690:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729695:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729699:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729704:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729709:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729713:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729718:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729723:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729727:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729732:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729737:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729770:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729777:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729782:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729787:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729791:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729796:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729801:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729805:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729811:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729815:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729820:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729824:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729829:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729834:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729839:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729843:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729848:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729853:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729858:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729862:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729867:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729872:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729885:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729889:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729894:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729898:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729903:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729908:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729913:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729918:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729923:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729928:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729933:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729938:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729943:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729948:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729952:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729957:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.729962:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.731605:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff984d39c62c00:6704] 0 exiting: rc = 1 00000100:00100000:3.0:1788832973.732089:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff984d06ca9c00:6706] 2 exiting: rc = 0 00000100:00100000:1.0:1788832973.732297:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff984d06ca8600:6705] 1 exiting: rc = 0 00000100:00100000:2.0:1788832973.732380:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732408:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732415:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732420:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732425:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732431:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732436:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732442:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732446:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732463:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732469:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732475:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732479:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732485:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732491:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732496:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732502:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732511:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732517:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732523:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732529:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732534:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732540:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732545:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732550:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732569:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732575:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732580:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732585:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732591:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732596:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732600:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732606:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732611:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732617:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732622:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732627:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732633:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732638:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732644:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732649:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732655:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732660:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732665:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732917:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732922:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732928:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732934:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732939:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732962:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732969:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732975:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732979:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732985:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732990:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.732995:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.733000:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.733005:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.733010:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.733015:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.733020:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.733024:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.733029:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832973.733033:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739206:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff984d3de99a00:6708] 1 exiting: rc = 0 00000100:00100000:0.0:1788832973.739273:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff984d3de98600:6707] 0 exiting: rc = 1 00000100:00100000:3.0:1788832973.739306:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739313:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739318:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739323:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739328:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739333:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739339:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739344:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739350:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739355:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739360:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739366:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739371:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739376:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739382:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739387:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739508:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739513:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739518:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739522:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739527:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739532:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739538:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739544:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739548:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739553:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739559:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739563:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739568:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739573:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739578:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739583:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739588:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739593:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739598:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739603:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739608:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739613:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739620:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739625:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739631:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739636:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739641:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739647:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739651:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739656:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739661:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739666:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739681:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739688:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739693:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739706:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739711:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739716:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739721:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739726:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739732:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739737:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739849:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739856:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739862:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739867:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739873:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.739885:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832973.741056:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff984d0645c600:6709] 0 exiting: rc = 1 00000100:00100000:1.0:1788832973.741095:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff984c04b1e200:6710] 1 exiting: rc = 0 00000100:00100000:3.0:1788832973.741274:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741282:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741289:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741295:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741309:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741315:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741320:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741326:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741332:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741338:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741343:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741348:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741354:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741359:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741365:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741371:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741389:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741465:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741474:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741479:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741485:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741491:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741506:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741511:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741517:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741524:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741529:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741535:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741556:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741564:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741570:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741576:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741581:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741587:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741592:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741598:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741603:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741609:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741616:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741621:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741640:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741647:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741652:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741658:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741664:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741670:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741722:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741728:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741734:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741741:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741892:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741898:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741918:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741925:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741931:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741938:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741943:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741957:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741962:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741970:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741980:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741986:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.741998:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832973.742005:0:13341:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788832973.749647:0:13341:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788832989.865099:0:13957:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788832998.566052:0:14419:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788832998.566057:0:14419:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788832998.566181:0:14419:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff984d1198f000 00000020:01000004:3.0:1788832998.566195:0:14419:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788832998.566203:0:14419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788832998.566215:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff984d06c319b8) 00000020:00000080:3.0:1788832998.566228:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788832998.602813:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788832998.610275:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788832998.610845:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 433: rc = 0 00100000:10000000:3.0:1788832998.611206:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 433: rc = 0 00100000:10000000:3.0:1788832998.611304:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 433: rc = 0 00100000:10000000:3.0:1788832998.611480:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 433: rc = 0 00100000:10000000:3.0:1788832998.611579:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 433: rc = 0 00100000:10000000:3.0:1788832998.612280:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788832998.612436:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 433: rc = 0 00100000:10000000:3.0:1788832998.612679:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 435: rc = 0 00100000:10000000:3.0:1788832998.614517:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 573: rc = 0 00100000:10000000:3.0:1788832998.614610:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 573: rc = 0 00100000:10000000:3.0:1788832998.615549:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 772: rc = 0 00100000:10000000:3.0:1788832998.616187:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 772: rc = 0 00100000:10000000:3.0:1788832998.616521:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 772: rc = 0 00100000:10000000:3.0:1788832998.617163:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 772: rc = 0 00100000:10000000:3.0:1788832998.617501:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 772: rc = 0 00100000:10000000:3.0:1788832998.618129:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 772: rc = 0 00100000:10000000:3.0:1788832998.618481:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 772: rc = 0 00100000:10000000:3.0:1788832998.618840:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00100000:10000000:3.0:1788832998.619219:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 772: rc = 0 00100000:10000000:3.0:1788832998.619527:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00100000:10000000:3.0:1788832998.619980:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:3.0:1788832998.620311:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 772: rc = 0 00100000:10000000:3.0:1788832998.621170:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 655: rc = 0 00100000:10000000:3.0:1788832998.621495:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 655: rc = 0 00100000:10000000:3.0:1788832998.621924:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 655: rc = 0 00100000:10000000:3.0:1788832998.622486:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 655: rc = 0 00100000:10000000:3.0:1788832998.622850:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 655: rc = 0 00100000:10000000:3.0:1788832998.623242:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 655: rc = 0 00100000:10000000:3.0:1788832998.623576:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 655: rc = 0 00100000:10000000:3.0:1788832998.624163:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 655: rc = 0 00100000:10000000:3.0:1788832998.624504:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 655: rc = 0 00100000:10000000:3.0:1788832998.625117:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 655: rc = 0 00100000:10000000:3.0:1788832998.625439:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 655: rc = 0 00100000:10000000:3.0:1788832998.625684:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 655: rc = 0 00100000:10000000:3.0:1788832998.626262:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 655: rc = 0 00100000:10000000:3.0:1788832998.626590:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 655: rc = 0 00100000:10000000:3.0:1788832998.627151:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 655: rc = 0 00100000:10000000:3.0:1788832998.627638:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 655: rc = 0 00100000:10000000:3.0:1788832998.629141:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 655: rc = 0 00100000:10000000:3.0:1788832998.629683:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 655: rc = 0 00100000:10000000:3.0:1788832998.630527:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 655: rc = 0 00100000:10000000:3.0:1788832998.630867:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 655: rc = 0 00100000:10000000:3.0:1788832998.631209:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 655: rc = 0 00100000:10000000:3.0:1788832998.631548:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 655: rc = 0 00100000:10000000:3.0:1788832998.631826:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 655: rc = 0 00100000:10000000:3.0:1788832998.632239:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 655: rc = 0 00100000:10000000:3.0:1788832998.632634:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 655: rc = 0 00100000:10000000:3.0:1788832998.632996:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 655: rc = 0 00100000:10000000:3.0:1788832998.633506:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 655: rc = 0 00100000:10000000:3.0:1788832998.633918:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 655: rc = 0 00100000:10000000:3.0:1788832998.634243:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 655: rc = 0 00100000:10000000:3.0:1788832998.634551:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 655: rc = 0 00100000:10000000:3.0:1788832998.634894:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 655: rc = 0 00100000:10000000:3.0:1788832998.635461:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 655: rc = 0 00100000:10000000:3.0:1788832998.635920:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 644: rc = 0 00100000:10000000:3.0:1788832998.636440:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788832998.636702:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 578: rc = 0 00100000:10000000:3.0:1788832998.636948:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788832998.637023:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 578: rc = 0 00100000:10000000:3.0:1788832998.637227:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788832998.637951:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 578: rc = 0 00100000:10000000:3.0:1788832998.638605:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788832998.638680:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 574: rc = 0 00100000:10000000:3.0:1788832998.639378:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788832998.639453:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 574: rc = 0 00100000:10000000:3.0:1788832998.639638:0:14419:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788832998.639700:0:14419:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 574: rc = 0 00000020:00000080:3.0:1788832998.640174:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788832998.640182:0:14419:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788832998.640191:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a5afa 00000020:01000004:3.0:1788832998.640197:0:14419:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788832998.640202:0:14419:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788832998.640207:0:14419:0:(tgt_mount.c:101:server_register_mount()) register mount ffff984d1198f000 from MGS 00000020:01000004:3.0:1788832998.640210:0:14419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788832998.640219:0:14419:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff984d06c30000) 00000020:00000080:3.0:1788832998.640227:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788832998.640270:0:14419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984d1198f000 from MGS, refs=2 00080000:01000000:3.0:1788832998.640274:0:14419:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788832998.640278:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a5b08 00000100:00100000:3.0:1788832998.640363:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788832998.640493:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788832998.640499:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788832998.641513:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788832998.641522:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788832998.642316:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832998.642506:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788832998.642512:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788832998.643494:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788832998.643503:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788832998.644004:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788832998.644011:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788832998.645008:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832998.645012:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832998.645014:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832998.645519:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832998.645521:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832998.645523:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832998.646289:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788832998.657244:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788832998.662023:0:14419:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788832998.662116:0:14419:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788832998.662119:0:14419:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788832998.667150:0:14428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788832998.667380:0:14419:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788832998.667496:0:14419:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788832998.668229:0:14419:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788832998.668590:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832998.668791:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788832998.668799:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788832998.671255:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788832998.671266:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788832998.678146:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788832998.678158:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788832998.678948:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788832998.678975:0:14419:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.141@tcp' 00000020:01000004:3.0:1788832998.678977:0:14419:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788832998.679006:0:14419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.141@tcp (typ=mgc) 00000020:00000080:3.0:1788832998.679019:0:14419:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.141@tcp (ffff984d06c33370) 00000020:00000080:3.0:1788832998.679034:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:2.0:1788832998.679156:0:14433:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:3.0:1788832998.679256:0:14419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984d1198e800@MGC192.168.206.141@tcp: add connection 192.168.206.141@tcp at head 00010000:00010000:3.0:1788832998.679523:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.141@tcp-0 is initialized 00000040:01000000:3.0:1788832998.679530:0:14419:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.141@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788832998.684198:0:14434:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788832998.684321:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.141@tcp (uuid 2036b91a-7b7b-4a70-ac28-9ff58ee109ad) 00000020:00000080:2.0:1788832998.684360:0:14419:0:(genops.c:1385:class_connect()) connect: client 2036b91a-7b7b-4a70-ac28-9ff58ee109ad, cookie 0xd270a10c1c6a5b16 00000100:00080000:2.0:1788832998.684371:0:14419:0:(import.c:510:import_select_connection()) MGC192.168.206.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788832998.684377:0:14419:0:(import.c:624:import_select_connection()) MGC192.168.206.141@tcp: import ffff984d1198e800 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:2.0:1788832998.684410:0:14419:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984d3ace4000 x1875726994329856/t0(0) o250->MGC192.168.206.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788832998.684456:0:14419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2036b91a-7b7b-4a70-ac28-9ff58ee109ad->MGS 00000020:01000004:2.0:1788832998.684482:0:14419:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788832998.684487:0:14419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788832998.684500:0:14419:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff984d10fb4d28) 00000020:00000080:2.0:1788832998.684511:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788832998.684736:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3313:1875726994329856:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788832998.684820:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832998.684891:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994329856 00000100:00100000:1.0:1788832998.684898:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994329856 00000100:00100000:1.0:1788832998.684926:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832998.684933:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1875726994329856:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788832998.684954:0:14430:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2036b91a-7b7b-4a70-ac28-9ff58ee109ad@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:1.0:1788832998.684974:0:14430:0:(genops.c:1385:class_connect()) connect: client 2036b91a-7b7b-4a70-ac28-9ff58ee109ad, cookie 0xd270a10c1c6a5b24 00000100:00080000:1.0:1788832998.685116:0:14430:0:(import.c:65:import_set_state_nolock()) ffff984d11112000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788832998.685165:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+5:3313:x1875726994329856:12345-0@lo:250:mount.lustre.0 Request processed in 230us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832998.685172:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832998.685208:0:3313:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788832998.685215:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.141@tcp: connect to target with instance 0 00000100:00080000:1.0:1788832998.685222:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788832998.685225:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788832998.685228:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d1198e800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788832998.685231:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788832998.685241:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788832998.685246:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3313:1875726994329856:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788832998.721239:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832998.721706:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788832998.721713:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788832998.726434:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788832998.726449:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788832998.728189:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788832998.728201:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788832998.728947:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788832998.729233:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788832998.729238:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788832998.739373:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788832998.739390:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788832998.796814:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832998.797156:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788832998.797163:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788832998.798540:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788832998.798550:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788832998.799131:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832998.799312:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788832998.799318:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788832998.800001:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788832998.800008:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788832998.800627:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832998.800815:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788832998.800820:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788832998.806330:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788832998.806531:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788832998.812643:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788832998.812882:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788832998.812889:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788832998.813933:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788832998.813942:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788832998.831667:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832998.831996:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788832998.832003:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788832998.833957:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788832998.833969:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788832998.835438:0:14419:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788832998.835449:0:14419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788832998.837709:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788832998.837735:0:14419:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788832998.837874:0:14419:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.141@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788832998.837999:0:14419:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.141@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788832998.838034:0:14419:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.141@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788832998.839990:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788832998.839993:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788832998.839994:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832998.839995:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832998.839997:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832998.839998:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832998.839999:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832998.840001:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788832998.840002:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832998.840017:0:14419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788832998.840020:0:14419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788832998.840022:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788832998.840024:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788832998.840025:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832998.840026:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832998.840027:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832998.840028:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832998.840029:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832998.840030:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788832998.840031:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832998.840032:0:14419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788832998.840230:0:14419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788832998.840250:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994329984:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788832998.840317:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832998.840372:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06348e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832998.840498:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994329984 00000100:00100000:3.0:1788832998.840505:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994329984 00000100:00100000:3.0:1788832998.840549:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832998.840557:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+5:14419:x1875726994329984:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788832998.840595:0:14432:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788832998.840598:0:14432:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788832998.840600:0:14432:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788832998.840930:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788832998.841488:0:14432:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788832998.842420:0:14454:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788832998.842436:0:14454:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788832998.842439:0:14454:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788832998.842476:0:14454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788832998.842820:0:14432:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788832998.842834:0:14432:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788832998.852328:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+5:14419:x1875726994329984:12345-0@lo:253:mount.lustre.0 Request processed in 11763us (12002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832998.852353:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832998.852731:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994329984:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788832998.852774:0:14419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788832998.852777:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788832998.852779:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788832998.852780:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832998.852781:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832998.852782:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832998.852784:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832998.852785:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788832998.852786:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788832998.852788:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832998.852790:0:14419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788832998.852808:0:14419:0:(tgt_mount.c:101:server_register_mount()) register mount ffff984d1198f000 from lustre-MDT0000 10000000:01000000:1.0:1788832998.852833:0:14419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788832998.852836:0:14419:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788832998.852841:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff984d06c33370 10000000:01000000:1.0:1788832998.852845:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788832998.852852:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff984d06c33370 from 1 10000000:01000000:1.0:1788832998.852855:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788832998.852892:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8e00/0xd270a10c1c6a5b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832998.852902:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8e00/0xd270a10c1c6a5b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832998.852913:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8e00/0xd270a10c1c6a5b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832998.852932:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994330112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788832998.852971:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832998.853022:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06348840 going to sleep for 11 seconds 00000100:00100000:2.0:1788832998.853161:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994330112 00000100:00100000:2.0:1788832998.853168:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994330112 00000100:00100000:2.0:1788832998.853211:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788832998.853220:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+5:14419:x1875726994330112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788832998.853231:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832998.853245:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b703800/0xd270a10c1c6a5b32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5b2b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832998.853267:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b703800/0xd270a10c1c6a5b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5b2b expref: 6 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832998.853276:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b703800/0xd270a10c1c6a5b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5b2b expref: 6 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832998.853286:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703800, rc 0) 00000100:00100000:2.0:1788832998.853351:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+6:14419:x1875726994330112:12345-0@lo:101:mount.lustre.0 Request processed in 131us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832998.853357:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788832998.853690:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994330112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788832998.853703:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8e00/0xd270a10c1c6a5b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b32 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832998.853711:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8e00/0xd270a10c1c6a5b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5b32 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832998.853785:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994330240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832998.853816:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832998.853841:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06de3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832998.853908:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994330240 00000100:00100000:0.0:1788832998.853913:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994330240 00000100:00100000:0.0:1788832998.853964:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832998.853972:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+6:14419:x1875726994330240:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832998.854208:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+6:14419:x1875726994330240:12345-0@lo:501:mount.lustre.0 Request processed in 236us (390us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788832998.854215:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788832998.854354:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994330240:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788832998.854385:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788832998.854404:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8e00/0xd270a10c1c6a5b2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b32 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832998.854412:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8e00/0xd270a10c1c6a5b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b32 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832998.854420:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984d1198f000 10000000:01000000:3.0:1788832998.854424:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788832998.854428:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff984d1198f000 10000000:01000000:3.0:1788832998.854431:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788832998.854433:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff984d1198f000 from 1 10000000:01000000:3.0:1788832998.854436:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788832998.854463:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada3c00/0xd270a10c1c6a5b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832998.854471:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3ada3c00/0xd270a10c1c6a5b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832998.854479:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3ada3c00/0xd270a10c1c6a5b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832998.854492:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994330368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788832998.854530:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832998.854553:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06de3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832998.854734:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994330368 00000100:00100000:0.0:1788832998.854739:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994330368 00000100:00100000:0.0:1788832998.854780:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832998.854786:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+6:14419:x1875726994330368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832998.854795:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832998.854807:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d036bb400/0xd270a10c1c6a5b40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5b39 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832998.854823:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d036bb400/0xd270a10c1c6a5b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5b39 expref: 7 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832998.854832:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d036bb400/0xd270a10c1c6a5b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5b39 expref: 7 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832998.854850:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bb400, rc 0) 00000100:00100000:0.0:1788832998.854892:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+7:14419:x1875726994330368:12345-0@lo:101:mount.lustre.0 Request processed in 106us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832998.854899:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788832998.855060:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994330368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788832998.855071:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3ada3c00/0xd270a10c1c6a5b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b40 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832998.855079:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3ada3c00/0xd270a10c1c6a5b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5b40 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832998.855090:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788832998.855102:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada3c00/0xd270a10c1c6a5b39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b40 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832998.855117:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3ada3c00/0xd270a10c1c6a5b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b40 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832998.855123:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788832998.855126:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788832998.855131:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff984d1198f000 10000000:01000000:3.0:1788832998.855139:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788832998.855141:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788832998.855143:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788832998.855158:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2e00/0xd270a10c1c6a5b47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832998.855165:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3ada2e00/0xd270a10c1c6a5b47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832998.855172:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3ada2e00/0xd270a10c1c6a5b47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832998.855185:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994330496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788832998.855211:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832998.855245:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06de3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788832998.855503:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994330496 00000100:00100000:1.0:1788832998.855508:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994330496 00000100:00100000:1.0:1788832998.855543:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832998.855551:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+7:14419:x1875726994330496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832998.855559:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832998.855569:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b7d8600/0xd270a10c1c6a5b4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5b47 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832998.855584:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b7d8600/0xd270a10c1c6a5b4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5b47 expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832998.855592:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b7d8600/0xd270a10c1c6a5b4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5b47 expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832998.855599:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d8600, rc 0) 00000100:00100000:1.0:1788832998.855637:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+8:14419:x1875726994330496:12345-0@lo:101:mount.lustre.0 Request processed in 87us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832998.855644:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788832998.855737:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994330496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788832998.856024:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3ada2e00/0xd270a10c1c6a5b47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b4e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832998.856033:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3ada2e00/0xd270a10c1c6a5b47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5b4e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832998.856097:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994330624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832998.856138:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832998.856169:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06de3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788832998.856306:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994330624 00000100:00100000:1.0:1788832998.856311:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994330624 00000100:00100000:1.0:1788832998.856356:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832998.856364:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+8:14419:x1875726994330624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788832998.856736:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+9:14419:x1875726994330624:12345-0@lo:501:mount.lustre.0 Request processed in 372us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832998.856765:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788832998.857013:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994330624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832998.857059:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994330752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788832998.857098:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832998.857146:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06de3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788832998.858343:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994330752 00000100:00100000:1.0:1788832998.858353:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994330752 00000100:00100000:1.0:1788832998.858417:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788832998.858438:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+9:14419:x1875726994330752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788832998.858805:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+9:14419:x1875726994330752:12345-0@lo:503:mount.lustre.0 Request processed in 368us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832998.858813:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788832998.859122:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994330752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832998.859913:0:14455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14455:1875726994330880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832998.859964:0:14455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832998.860000:0:14455:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d03cc5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832998.860952:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994330880 00000100:00100000:1.0:1788832998.860961:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994330880 00000100:00100000:1.0:1788832998.861002:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832998.861010:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+9:14455:x1875726994330880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832998.861775:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+9:14455:x1875726994330880:12345-0@lo:502:llog_process_th.0 Request processed in 763us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832998.861784:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788832998.864469:0:14455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14455:1875726994330880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788832998.864518:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832998.864531:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832998.864533:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788832998.864540:0:14455:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788832998.864543:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832998.864557:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff984d20343370) 00000020:00000080:0.0:1788832998.864576:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788832998.864582:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788832998.864674:0:14455:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788832998.864681:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a5b5c 00000020:00000080:0.0:1788832998.865031:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788832998.865141:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832998.865148:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832998.865149:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788832998.865152:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832998.865155:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832998.865156:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788832998.865159:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832998.865173:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff984d203419b8) 00000020:00000080:0.0:1788832998.865183:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788832998.865188:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788832998.865190:0:14455:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788832998.865192:0:14455:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788832998.865198:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788832998.865249:0:14455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984d1198f000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788832998.865264:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff984d20344d28) 00000020:00000080:0.0:1788832998.865272:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788832998.865328:0:14455:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788832998.865467:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd270a10c1c6a5b71 00000020:00000080:0.0:1788832998.865567:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788832998.865573:0:14455:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788832998.865578:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd270a10c1c6a5b78 00080000:01000000:0.0:1788832998.865582:0:14455:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788832998.865585:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a5b7f 00010000:00010000:3.0:1788832998.957245:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788832998.957905:0:14455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788832998.958150:0:14455:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788832998.958950:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff984d06c34d28) 00000020:00000080:3.0:1788832998.958968:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788832998.959024:0:14455:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788832998.959030:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a5b8d 00000020:00000080:3.0:1788832998.970430:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788832998.992734:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd270a10c1c6a5b94 00000020:00000080:0.0:1788832998.993208:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788832998.993218:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832998.993224:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832998.993227:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788832998.993231:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788832998.993234:0:14455:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788832998.993235:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788832998.993237:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788832998.993238:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788832998.993241:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832998.993242:0:14455:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788832998.993244:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832998.993249:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832998.993250:0:14455:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788832998.993254:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788832998.993286:0:14455:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788832998.993298:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832998.993301:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832998.993308:0:14455:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788832998.993312:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788832998.993315:0:14455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788832998.993319:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832998.993320:0:14455:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788832998.993323:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788832998.993328:0:14455:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.141@tcp to nid 0x20000c0a8ce8d (192.168.206.141@tcp) 00000020:01000000:0.0:1788832998.993353:0:14455:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788832998.993356:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832998.993436:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff984d20340000) 00000020:00000080:0.0:1788832998.993453:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788832998.993460:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788832998.993526:0:14455:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788832998.993531:0:14455:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788832998.993541:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a5ba2 00010000:00080000:0.0:1788832998.993572:0:14455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984d031b3000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.141@tcp at head 00010000:00010000:0.0:1788832998.993869:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788832998.994236:0:14455:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788832998.994776:0:14455:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788832998.995692:0:14455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832998.995775:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788832998.995843:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000020:00000080:1.0:1788832998.996960:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788832998.996972:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788832998.997003:0:14455:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788832998.997022:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd270a10c1c6a5ba9 00000100:00080000:1.0:1788832998.997032:0:14455:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832998.997037:0:14455:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff984d031b3000 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:1.0:1788832998.997069:0:14455:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984d3b37c380 x1875726994331008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832998.997095:0:14455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788832998.997156:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832998.997160:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832998.997162:0:14455:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788832998.997165:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788832998.997167:0:14455:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788832998.997169:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788832998.997170:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788832998.997171:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788832998.997181:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832998.997182:0:14455:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788832998.997186:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788832998.997190:0:14455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788832998.997193:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832998.997194:0:14455:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788832998.997196:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788832998.997200:0:14455:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.141@tcp to nid 0x20000c0a8ce8d (192.168.206.141@tcp) 00000020:01000000:1.0:1788832998.997222:0:14455:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788832998.997225:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788832998.997236:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff984d06484d28) 00000020:00000080:1.0:1788832998.997248:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788832998.997253:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788832998.997343:0:14455:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788832998.997348:0:14455:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788832998.997354:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd270a10c1c6a5bb7 00000100:00100000:2.0:1788832998.997489:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994331008:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788832998.997542:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726994331008 offset 0 length 520: 4 00000040:00080000:0.0:1788832998.997729:0:14459:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788832998.997734:0:14459:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00010000:00080000:0.0:1788832998.998302:0:14455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984d031b1000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.141@tcp at head 00010000:00010000:0.0:1788832998.998613:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788832998.999525:0:14455:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788832998.999550:0:14455:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788832999.000193:0:14455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832999.000255:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788832999.000340:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788832999.013527:0:14461:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788832999.013535:0:14461:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788832999.014095:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788832999.014118:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788832999.014154:0:14455:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788832999.014174:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd270a10c1c6a5bbe 00000100:00080000:3.0:1788832999.014183:0:14455:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788832999.014188:0:14455:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff984d031b1000 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:3.0:1788832999.014221:0:14455:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984d3aa3dc00 x1875726994331136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788832999.014251:0:14455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788832999.014312:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832999.014317:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832999.014319:0:14455:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788832999.014322:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832999.014324:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832999.014325:0:14455:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788832999.014328:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788832999.014330:0:14455:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788832999.014332:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832999.014335:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832999.014336:0:14455:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788832999.014339:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832999.014347:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832999.014349:0:14455:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788832999.014353:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788832999.014384:0:14455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14455:1875726994331264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832999.014458:0:14455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832999.014498:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994331264 00000100:00100000:3.0:1788832999.014504:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994331264 00000100:00100000:3.0:1788832999.014540:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788832999.014549:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+9:14455:x1875726994331264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832999.014793:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+9:14455:x1875726994331264:12345-0@lo:502:llog_process_th.0 Request processed in 243us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832999.014801:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788832999.014856:0:14455:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06342d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832999.014875:0:14455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14455:1875726994331264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788832999.014899:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832999.014903:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832999.014905:0:14455:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788832999.014909:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788832999.014956:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788832999.014974:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788832999.014988:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2e00/0xd270a10c1c6a5b47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b4e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.014998:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3ada2e00/0xd270a10c1c6a5b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b4e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832999.015006:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984d1198f000 from 1 10000000:01000000:3.0:1788832999.015009:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788832999.015033:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.015048:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.015058:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832999.015072:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994331392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788832999.015099:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832999.015126:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06342d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832999.015324:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994331392 00000100:00100000:1.0:1788832999.015329:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994331392 00000100:00100000:1.0:1788832999.015361:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788832999.015368:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+9:14419:x1875726994331392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832999.015377:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832999.015392:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b7d8c00/0xd270a10c1c6a5bcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5bc5 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.015411:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b7d8c00/0xd270a10c1c6a5bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5bc5 expref: 10 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.015421:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b7d8c00/0xd270a10c1c6a5bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5bc5 expref: 10 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.015430:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d8c00, rc 0) 00000100:00100000:1.0:1788832999.015472:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+10:14419:x1875726994331392:12345-0@lo:101:mount.lustre.0 Request processed in 104us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832999.015479:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788832999.015514:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994331392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832999.015526:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5bcc expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.015534:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5bcc expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832999.016133:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994331520:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788832999.016171:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832999.016201:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d29b02000 going to sleep for 11 seconds 00000100:00100000:2.0:1788832999.016341:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994331136:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788832999.016372:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726994331136 offset 0 length 520: 4 00000100:00100000:3.0:1788832999.016955:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994331520 00000100:00100000:3.0:1788832999.016963:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994331520 00000100:00100000:3.0:1788832999.016996:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832999.017005:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+10:14419:x1875726994331520:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788832999.017023:0:14431:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788832999.017029:0:14431:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788832999.017275:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+10:14419:x1875726994331520:12345-0@lo:256:mount.lustre.0 Request processed in 270us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832999.017283:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788832999.020993:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994331520:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788832999.021597:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788832999.021843:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5bcc expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832999.021914:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5bcc expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832999.021926:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d1198f000 from 1 10000000:01000000:2.0:1788832999.021929:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788832999.021968:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832999.021977:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832999.021986:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832999.022009:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994331648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788832999.022071:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832999.022118:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10f8e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832999.022190:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994331648 00000100:00100000:1.0:1788832999.022198:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994331648 00000100:00100000:1.0:1788832999.022254:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832999.022263:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+10:14419:x1875726994331648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832999.022276:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832999.022289:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b7d9200/0xd270a10c1c6a5bda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5bd3 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.022311:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b7d9200/0xd270a10c1c6a5bda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5bd3 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.022320:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b7d9200/0xd270a10c1c6a5bda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5bd3 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.022329:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d9200, rc 0) 00000100:00100000:1.0:1788832999.022387:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:14419:x1875726994331648:12345-0@lo:101:mount.lustre.0 Request processed in 125us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832999.022394:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788832999.022483:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994331648:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832999.022497:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5bda expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832999.022505:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5bda expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832999.022556:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994331776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832999.022584:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832999.022612:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aa53300 going to sleep for 11 seconds 00000100:00100000:1.0:1788832999.022661:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994331776 00000100:00100000:1.0:1788832999.022666:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994331776 00000100:00100000:1.0:1788832999.022698:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788832999.022705:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:14419:x1875726994331776:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788832999.023312:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:14419:x1875726994331776:12345-0@lo:501:mount.lustre.0 Request processed in 606us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832999.023320:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788832999.030704:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994331776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832999.030795:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994331904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832999.030869:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832999.030909:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aa53300 going to sleep for 11 seconds 00000100:00100000:1.0:1788832999.031006:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994331904 00000100:00100000:1.0:1788832999.031013:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994331904 00000100:00100000:1.0:1788832999.031064:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788832999.031073:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:14419:x1875726994331904:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788832999.031260:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:14419:x1875726994331904:12345-0@lo:503:mount.lustre.0 Request processed in 187us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832999.031268:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788832999.031376:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994331904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832999.031734:0:14463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14463:1875726994332032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832999.031841:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832999.031907:0:14463:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aa533c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832999.038200:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994332032 00000100:00100000:3.0:1788832999.038214:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994332032 00000100:00100000:2.0:1788832999.038385:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788832999.038395:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:14463:x1875726994332032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832999.038705:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:14463:x1875726994332032:12345-0@lo:502:llog_process_th.0 Request processed in 311us (6863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832999.038714:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788832999.038838:0:14463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14463:1875726994332032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788832999.038873:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832999.038883:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832999.038885:0:14463:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788832999.038893:0:14463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984d1198f000 00000020:00000080:0.0:1788832999.038900:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788832999.038907:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832999.038909:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832999.038910:0:14463:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788832999.038913:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832999.038915:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832999.038916:0:14463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788832999.038920:0:14463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984d1198f000 00000020:00000080:0.0:1788832999.038922:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788832999.038978:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832999.038981:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832999.038982:0:14463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788832999.038985:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832999.038988:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832999.038989:0:14463:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788832999.038992:0:14463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984d1198f000 00000020:00000080:0.0:1788832999.038994:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788832999.039040:0:14463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14463:1875726994332160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832999.039082:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832999.053905:0:14463:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aa533c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832999.056717:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994332160 00000100:00100000:1.0:1788832999.056733:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994332160 00000100:00100000:1.0:1788832999.056793:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788832999.056803:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:14463:x1875726994332160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832999.057043:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:14463:x1875726994332160:12345-0@lo:502:llog_process_th.0 Request processed in 241us (17960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832999.057051:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788832999.057120:0:14463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14463:1875726994332160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788832999.057154:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832999.057165:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832999.057168:0:14463:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788832999.057172:0:14463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788832999.057234:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788832999.057248:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788832999.057267:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5bda expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.057277:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5bda expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832999.057315:0:14419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788832999.057318:0:14419:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984d1198f000 10000000:01000000:1.0:1788832999.057321:0:14419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984d1198f000 10000000:01000000:1.0:1788832999.057324:0:14419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788832999.057329:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984d1198f000 from 1 10000000:01000000:1.0:1788832999.057332:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788832999.057359:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8200/0xd270a10c1c6a5be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.057366:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8200/0xd270a10c1c6a5be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.057376:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8200/0xd270a10c1c6a5be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832999.057396:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994332288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788832999.057429:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832999.057462:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d11418540 going to sleep for 11 seconds 00000100:00100000:1.0:1788832999.057481:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994332288 00000100:00100000:1.0:1788832999.057485:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994332288 00000100:00100000:1.0:1788832999.057512:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788832999.057519:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:14419:x1875726994332288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832999.057527:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832999.057537:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b7d9e00/0xd270a10c1c6a5be8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5be1 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.057556:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b7d9e00/0xd270a10c1c6a5be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5be1 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.057566:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b7d9e00/0xd270a10c1c6a5be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5be1 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.057575:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d9e00, rc 0) 00000100:00100000:1.0:1788832999.057604:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14419:x1875726994332288:12345-0@lo:101:mount.lustre.0 Request processed in 86us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832999.057610:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788832999.057634:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994332288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832999.057644:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8200/0xd270a10c1c6a5be1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5be8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.057652:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8200/0xd270a10c1c6a5be1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5be8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832999.057689:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994332416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788832999.057712:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832999.057720:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d11418540 going to sleep for 11 seconds 00000100:00100000:1.0:1788832999.057739:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994332416 00000100:00100000:1.0:1788832999.057762:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994332416 00000100:00100000:1.0:1788832999.057786:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788832999.057792:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14419:x1875726994332416:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788832999.057990:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14419:x1875726994332416:12345-0@lo:501:mount.lustre.0 Request processed in 197us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832999.057997:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788832999.058021:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994332416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788832999.058045:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994332544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788832999.058080:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832999.058089:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d11418540 going to sleep for 11 seconds 00000100:00100000:1.0:1788832999.058119:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994332544 00000100:00100000:1.0:1788832999.058123:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994332544 00000100:00100000:1.0:1788832999.058139:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788832999.058145:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14419:x1875726994332544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788832999.058267:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14419:x1875726994332544:12345-0@lo:503:mount.lustre.0 Request processed in 121us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832999.058274:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788832999.058305:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994332544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788832999.063925:0:14468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14468:1875726994332672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832999.064013:0:14468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832999.064066:0:14468:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d97d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788832999.066778:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994332672 00000100:00100000:0.0:1788832999.066791:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994332672 00000100:00100000:0.0:1788832999.066838:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788832999.066847:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14468:x1875726994332672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832999.076336:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14468:x1875726994332672:12345-0@lo:502:llog_process_th.0 Request processed in 9481us (12314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832999.076351:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788832999.077859:0:14468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14468:1875726994332672:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788832999.077931:0:14468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788832999.077948:0:14468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff984d06434d28) 00000020:00000080:0.0:1788832999.077974:0:14468:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788832999.078068:0:14468:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984d1198f000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788832999.078072:0:14468:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984d1198f000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788832999.078074:0:14468:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984d1198f000 4 00010000:00080000:0.0:1788832999.078101:0:14468:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984c054d8800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.141@tcp at head 00010000:00010000:0.0:1788832999.079779:0:14468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788832999.079980:0:14468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788832999.080011:0:14468:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788832999.080023:0:14468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd270a10c1c6a5bf6 00000100:00080000:0.0:1788832999.080033:0:14468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788832999.080038:0:14468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff984c054d8800 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:0.0:1788832999.080068:0:14468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984c04ba5180 x1875726994332800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788832999.080095:0:14468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788832999.082903:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875726994332800:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788832999.082975:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832999.083943:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994332800 00000100:00100000:0.0:1788832999.083953:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994332800 00000100:00100000:0.0:1788832999.083990:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832999.083997:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875726994332800:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788832999.084066:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875726994332800:12345-0@lo:38:llog_process_th.0 Request processed in 68us (1091us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788832999.084073:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832999.084197:0:14468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14468:1875726994332928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832999.084240:0:14468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832999.084268:0:14468:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aa53b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832999.084387:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788832999.084395:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984c054d8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788832999.084400:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788832999.084403:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875726994332800:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788832999.084539:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994332928 00000100:00100000:3.0:1788832999.084544:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994332928 00000100:00100000:3.0:1788832999.084584:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788832999.084592:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14468:x1875726994332928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832999.084861:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14468:x1875726994332928:12345-0@lo:502:llog_process_th.0 Request processed in 270us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832999.084869:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788832999.084978:0:14468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14468:1875726994332928:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788832999.085005:0:14468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788832999.085083:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788832999.085111:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788832999.085133:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8200/0xd270a10c1c6a5be1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5be8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.085143:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8200/0xd270a10c1c6a5be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5be8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788832999.085185:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788832999.085188:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788832999.085189:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832999.085190:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832999.085192:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832999.085193:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832999.085194:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788832999.085196:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788832999.085198:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832999.085199:0:14419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788832999.085203:0:14419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788832999.085205:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788832999.085206:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788832999.085207:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832999.085209:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832999.085210:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832999.085211:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832999.085212:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788832999.085213:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788832999.085214:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832999.085215:0:14419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788832999.085231:0:14419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788832999.085241:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994333056:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788832999.085278:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832999.085306:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d11418480 going to sleep for 11 seconds 00000100:00100000:1.0:1788832999.085321:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994333056 00000100:00100000:1.0:1788832999.085330:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994333056 00000100:00100000:1.0:1788832999.085358:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788832999.085364:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14419:x1875726994333056:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788832999.085384:0:14432:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788832999.085395:0:14432:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788832999.141092:0:14432:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788832999.141115:0:14432:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788832999.141148:0:14453:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788832999.141153:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788832999.141174:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.141191:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d3b7d8c00/0xd270a10c1c6a5bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5bc5 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.141199:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.141235:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d3b7d8c00/0xd270a10c1c6a5bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a5bc5 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.141249:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d3b7d8c00/0xd270a10c1c6a5bcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a5bc5 expref: 12 pid: 14432 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832999.141263:0:14453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1875726994333184:0@lo:104: 00000100:00100000:1.0:1788832999.141320:0:14453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832999.141422:0:14453:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d114189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832999.141423:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994333184 00000100:00100000:0.0:1788832999.141433:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994333184 00000100:00100000:0.0:1788832999.141492:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832999.141502:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:14453:x1875726994333184:12345-0@lo:104: 00010000:00010000:0.0:1788832999.141539:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5bcc expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832999.141622:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788832999.141640:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:14453:x1875726994333184:12345-0@lo:104: Request processed in 129us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832999.141648:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832999.142189:0:14453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1875726994333184:0@lo:104: 00010000:00010000:1.0:1788832999.142210:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.142239:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832999.142245:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5bcc expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.142252:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2600 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1788832999.142256:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a5bcc expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.142264:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a5bcc expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832999.142270:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a5bcc expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832999.142275:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788832999.142314:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5bcc expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.142320:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832999.142339:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5bcc expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.142346:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5bc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5bcc expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.142361:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832999.142363:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832999.142462:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832999.142488:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3317:1875726994333312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832999.142532:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832999.148916:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994333312 00000100:00100000:3.0:1788832999.148931:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994333312 00010000:00010000:3.0:1788832999.148965:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d3b7d8c00/0xd270a10c1c6a5bcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5bc5 expref: 13 pid: 14432 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832999.149009:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832999.149019:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+13:3317:x1875726994333312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788832999.149032:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832999.149037:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d3b7d8c00/0xd270a10c1c6a5bcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5bc5 expref: 13 pid: 14432 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.149049:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d3b7d8c00/0xd270a10c1c6a5bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a5bc5 expref: 13 pid: 14432 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.149066:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b7d8c00/0xd270a10c1c6a5bcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a5bc5 expref: 13 pid: 14432 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.149082:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.149090:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788832999.149119:0:14422:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007966853s 00010000:00010000:3.0:1788832999.149124:0:14422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.149149:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.149156:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.149162:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.149169:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d9800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788832999.149174:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.149183:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.149197:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.149204:0:14453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832999.149208:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832999.149218:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832999.149225:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5bfd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832999.149287:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:3317:x1875726994333312:12345-0@lo:103:ldlm_bl.0 Request processed in 267us (6751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832999.149296:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832999.149722:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3317:1875726994333312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832999.156528:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:14419:x1875726994333056:12345-0@lo:253:mount.lustre.0 Request processed in 71156us (71242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832999.156542:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788832999.158406:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14419:1875726994333056:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788832999.158422:0:14419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788832999.158425:0:14419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788832999.158427:0:14419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788832999.158428:0:14419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832999.158429:0:14419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832999.158430:0:14419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832999.158431:0:14419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832999.158433:0:14419:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788832999.158434:0:14419:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788832999.158437:0:14419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832999.158439:0:14419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788832999.158453:0:14419:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788832999.167224:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788832999.167398:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788832999.167688:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788832999.167891:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788832999.168193:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788832999.168362:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788832999.170400:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788832999.170571:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788832999.171247:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788832999.171484:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788832999.171799:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788832999.171975:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788832999.227708:0:14419:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788832999.227907:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788832999.228004:0:14475:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788832999.228008:0:14475:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788832999.229613:0:14476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788832999.229710:0:14476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788832999.232301:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788832999.232425:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788832999.232869:0:14419:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788832999.232882:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788832999.233010:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832999.239482:0:14476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788832999.239555:0:14476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788832999.239559:0:14476:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788832999.241555:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788832999.242143:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788832999.242178:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788832999.244321:0:14419:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788832999.251096:0:14419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788832999.309230:0:14419:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788832999.309267:0:14419:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae04416db988 00100000:10000000:3.0:1788832999.309274:0:14419:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788832999.314566:0:14419:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788832999.314582:0:14419:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.141@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788832999.314592:0:14419:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788832999.314610:0:14419:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788832999.703473:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788833000.150363:0:14470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788833000.661859:0:14434:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788833000.661867:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984d1198f000 from 6 10000000:01000000:0.0:1788833000.661872:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788833000.661919:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833000.661931:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833000.661955:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833000.661980:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994333440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788833000.662053:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833000.662177:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d069543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833000.662267:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994333440 00000100:00100000:1.0:1788833000.662275:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994333440 00000100:00100000:1.0:1788833000.662328:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788833000.662337:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:14434:x1875726994333440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833000.662350:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833000.662369:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b7d9600/0xd270a10c1c6a5c0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5c04 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833000.662391:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b7d9600/0xd270a10c1c6a5c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c04 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833000.662402:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b7d9600/0xd270a10c1c6a5c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c04 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833000.662411:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d9600, rc 0) 00000100:00100000:1.0:1788833000.662522:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14434:x1875726994333440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833000.662530:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788833000.665853:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994333440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788833000.665880:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c0b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833000.665894:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5c0b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833000.666300:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994333568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788833000.666358:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833000.666460:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d22b8de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833000.668059:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994333568 00000100:00100000:2.0:1788833000.668070:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994333568 00000100:00100000:2.0:1788833000.668191:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788833000.668202:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14434:x1875726994333568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788833000.668225:0:14432:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788833000.668245:0:14432:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788833000.668249:0:14432:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788833000.668374:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14434:x1875726994333568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 173us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833000.668381:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788833000.668465:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994333568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788833000.668515:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788833000.668524:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c0b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833000.668534:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c0b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833000.726134:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788833001.174807:0:14470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788833001.754510:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833002.773922:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833003.801183:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788833003.972327:0:14718:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788833004.182790:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788833004.182797:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788833004.182800:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788833004.182803:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788833004.182805:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788833004.182809:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788833004.182813:0:38:0:(import.c:65:import_set_state_nolock()) ffff984c054d8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788833004.182825:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff984c054d8800 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:1.0:1788833004.182973:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984d3b37f800 x1875726994333824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788833004.183108:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788833004.183122:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3315:1875726994333696:0@lo:400:kworker.0 00000100:00100000:1.0:1788833004.183197:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833004.183257:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875726994333824:0@lo:38:kworker.0 00000100:00100000:1.0:1788833004.183284:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833004.183319:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994333696 00000100:00100000:1.0:1788833004.183326:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994333696 00000100:00100000:1.0:1788833004.183365:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788833004.183374:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:3315:x1875726994333696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833004.183420:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:3315:x1875726994333696:12345-0@lo:400:kworker.0 Request processed in 47us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833004.183427:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788833004.183472:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3315:1875726994333696:0@lo:400:kworker.0 00000100:00100000:3.0:1788833004.185779:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994333824 00000100:00100000:3.0:1788833004.185791:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994333824 00000100:00100000:3.0:1788833004.185836:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788833004.185844:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875726994333824:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788833004.185869:0:14439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:3.0:1788833004.185904:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd270a10c1c6a5c12 00000004:00100000:3.0:1788833004.185919:0:14439:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788833004.186063:0:14439:0:(import.c:65:import_set_state_nolock()) ffff984d3faa4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788833004.186143:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875726994333824:12345-0@lo:38:kworker.0 Request processed in 298us (2857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833004.186151:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788833004.188998:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff984d3b37f800 x1875726994333824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788833014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788833004.189020:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788833004.189027:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788833004.189033:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788833004.189036:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984c054d8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788833004.189043:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875726994333824:0@lo:38:kworker.0 00010000:00010000:0.0:1788833004.826528:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833005.845936:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833006.871440:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788833007.250337:0:14870:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedac05170 20000000:00000080:3.0:1788833007.250354:0:14870:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984d09322800 uarg=0000000000000000 20000000:01000000:3.0:1788833007.250385:0:14870:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788833007.250392:0:14870:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788833007.250396:0:14870:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788833007.251524:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788833007.251684:0:14870:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788833007.262285:0:14870:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788833007.262471:0:14870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833007.262495:0:14870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d3b7d9200/0xd270a10c1c6a5bda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5bd3 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833007.262522:0:14870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833007.262562:0:14870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d3b7d9200/0xd270a10c1c6a5bda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a5bd3 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833007.262575:0:14870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d3b7d9200/0xd270a10c1c6a5bda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a5bd3 expref: 11 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833007.262588:0:14870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14870:1875726994333952:0@lo:104: 00000100:00100000:2.0:1788833007.262644:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833007.262699:0:14870:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06955180 going to sleep for 11 seconds 00000100:00100000:0.0:1788833007.262785:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994333952 00000100:00100000:0.0:1788833007.262793:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994333952 00000100:00100000:0.0:1788833007.262839:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788833007.262848:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:14870:x1875726994333952:12345-0@lo:104: 00010000:00010000:0.0:1788833007.262859:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5bda expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833007.262917:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788833007.262923:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:14870:x1875726994333952:12345-0@lo:104: Request processed in 77us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833007.262929:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788833007.262948:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833007.262953:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5bda expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833007.262960:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702600 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:0.0:1788833007.262963:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a5bda expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833007.262976:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a5bda expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788833007.262982:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a5bda expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788833007.262988:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788833007.263014:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5bda expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833007.263020:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788833007.263039:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5bda expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833007.263046:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d3b702600/0xd270a10c1c6a5bd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5bda expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833007.263070:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833007.263072:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833007.263074:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788833007.263086:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788833007.263096:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3314:1875726994334080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788833007.263124:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833007.263297:0:14870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14870:1875726994333952:0@lo:104: 00010000:00010000:2.0:1788833007.263315:0:14870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833007.263376:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994334080 00000100:00100000:1.0:1788833007.263382:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994334080 00010000:00010000:1.0:1788833007.263400:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d3b7d9200/0xd270a10c1c6a5bda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5bd3 expref: 12 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833007.263430:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788833007.263437:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:3314:x1875726994334080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788833007.263454:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833007.263459:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d3b7d9200/0xd270a10c1c6a5bda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5bd3 expref: 12 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833007.263469:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d3b7d9200/0xd270a10c1c6a5bda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a5bd3 expref: 12 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833007.263481:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b7d9200/0xd270a10c1c6a5bda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a5bd3 expref: 12 pid: 14432 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833007.263493:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833007.263500:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833007.263512:0:14423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833007.263519:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833007.263526:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833007.263532:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833007.263538:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702a00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833007.263542:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833007.263565:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833007.263588:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833007.263598:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833007.263636:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:3314:x1875726994334080:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833007.263642:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788833007.263669:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3314:1875726994334080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788833007.263767:0:14870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833007.263776:0:14870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833007.263781:0:14870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b702a00/0xd270a10c1c6a5c19 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833007.905613:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833008.279101:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832998/real 1788832998] req@ffff984d3b37c380 x1875726994331008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833008 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833008.279136:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984d3b37c380 x1875726994331008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833008 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788833008.279154:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d031b3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788833008.279175:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788833008.279178:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994331008:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788833008.279587:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788833008.279591:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788833008.279594:0:36:0:(import.c:65:import_set_state_nolock()) ffff984d031b3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788833008.279599:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:3.0:1788833008.279603:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788833008.279609:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff984d031b3000 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:3.0:1788833008.279627:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984d3aa3e680 x1875726994334336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788833008.279642:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788833008.279645:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788833008.279826:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994334336:0@lo:8:kworker.0 00000400:00000100:3.0:1788833008.279877:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726994334336 offset 0 length 520: 4 00000100:00100000:2.0:1788833008.279989:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994334464:0@lo:400:kworker.0 00000100:00100000:2.0:1788833008.280028:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833008.280052:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788833008.280068:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3317:1875726994334208:0@lo:400:kworker.0 00000100:00100000:2.0:1788833008.280093:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833008.280117:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994334208 00000100:00100000:2.0:1788833008.280123:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994334208 00000100:00100000:2.0:1788833008.280160:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788833008.280169:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:3317:x1875726994334208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833008.280211:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:3317:x1875726994334208:12345-0@lo:400:kworker.0 Request processed in 43us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833008.280230:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788833008.280269:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3317:1875726994334208:0@lo:400:kworker.0 00000100:00100000:3.0:1788833008.283254:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994334464 00000100:00100000:3.0:1788833008.283270:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994334464 00000100:00100000:3.0:1788833008.283454:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788833008.283466:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994334464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833008.283556:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994334464:12345-0@lo:400:kworker.0 Request processed in 93us (3527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833008.283564:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788833008.283693:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff984d3aa3fb80 x1875726994334464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833008.283707:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994334464:0@lo:400:kworker.0 10000000:01000000:0.0:1788833008.597849:0:14434:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788833008.597856:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d1198f000 from 10 10000000:01000000:0.0:1788833008.597862:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788833008.597918:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833008.597947:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833008.597959:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833008.597994:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994334592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788833008.598073:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833008.598137:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788833008.598430:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994334592 00000100:00100000:1.0:1788833008.598439:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994334592 00000100:00100000:1.0:1788833008.598540:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788833008.598549:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+11:14434:x1875726994334592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833008.598562:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833008.598575:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5c27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5c20 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833008.598606:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c20 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833008.598616:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c20 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833008.598624:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d9800, rc 0) 00000100:00100000:1.0:1788833008.598671:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14434:x1875726994334592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833008.598677:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788833008.598787:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994334592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833008.598802:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c27 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833008.598810:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5c27 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833008.598859:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994334720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833008.598884:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833008.604677:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994334720 00000100:00100000:2.0:1788833008.604690:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994334720 00000100:00100000:3.0:1788833008.604777:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788833008.604801:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14434:x1875726994334720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833008.605455:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14434:x1875726994334720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 654us (6567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833008.605464:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788833008.606400:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d92f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788833008.606428:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994334720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833008.606480:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994334848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788833008.606550:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833008.606564:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788833008.606786:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994334848 00000100:00100000:1.0:1788833008.606792:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994334848 00000100:00100000:1.0:1788833008.606851:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788833008.606861:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0be46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14434:x1875726994334848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833008.607039:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0be46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:14434:x1875726994334848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833008.607046:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788833008.607261:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994334848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788833008.608861:0:14931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788833008.609128:0:14434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788833008.609156:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788833008.609166:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c27 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833008.609177:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c27 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833008.918872:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833009.301844:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832999/real 1788832999] req@ffff984d3aa3dc00 x1875726994331136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833009 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833009.301875:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984d3aa3dc00 x1875726994331136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833009 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788833009.301894:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d031b1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788833009.301921:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788833009.301925:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994331136:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788833009.302004:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788833009.302010:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788833009.302012:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788833009.302015:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788833009.302018:0:36:0:(import.c:65:import_set_state_nolock()) ffff984d031b1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788833009.302023:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:1.0:1788833009.302027:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788833009.302047:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff984d031b1000 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:1.0:1788833009.302086:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984d3b37c380 x1875726994334976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788833009.302188:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994335104:0@lo:400:kworker.0 00000100:00100000:3.0:1788833009.302200:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994334976:0@lo:8:kworker.0 00000400:00000100:3.0:1788833009.302248:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726994334976 offset 0 length 520: 4 00000100:00100000:0.0:1788833009.302445:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833009.302608:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994335104 00000100:00100000:2.0:1788833009.302617:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994335104 00000100:00100000:2.0:1788833009.302894:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788833009.302905:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994335104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833009.302969:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994335104:12345-0@lo:400:kworker.0 Request processed in 67us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833009.302977:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788833009.303158:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff984d3b37f800 x1875726994335104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833009.303170:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994335104:0@lo:400:kworker.0 00010000:00010000:2.0:1788833009.946482:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833010.967951:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788833011.417728:0:14470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788833011.989958:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788833012.356163:0:15119:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788833012.356167:0:15119:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788833012.356444:0:15119:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff984d11126000 00000020:01000004:1.0:1788833012.356461:0:15119:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788833012.356473:0:15119:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788833012.356485:0:15119:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff984d06483370) 00000020:00000080:1.0:1788833012.356500:0:15119:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788833012.388046:0:15119:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788833012.388514:0:15119:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788833012.389813:0:15119:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788833012.390132:0:15119:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788833012.390502:0:15119:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788833012.391127:0:15119:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1788833012.391290:0:15119:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1788833012.391534:0:15119:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1788833012.394340:0:15119:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 588: rc = 0 00100000:10000000:3.0:1788833012.394726:0:15119:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 588: rc = 0 00100000:10000000:3.0:1788833012.395027:0:15119:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 588: rc = 0 00100000:10000000:3.0:1788833012.395312:0:15119:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 588: rc = 0 00100000:10000000:3.0:1788833012.395544:0:15119:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 588: rc = 0 00100000:10000000:3.0:1788833012.395767:0:15119:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 588: rc = 0 00000020:00000080:3.0:1788833012.402600:0:15119:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788833012.402616:0:15119:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788833012.402628:0:15119:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd270a10c1c6a5c35 00000020:01000004:3.0:1788833012.402636:0:15119:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788833012.402736:0:15119:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.141@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788833012.402740:0:15119:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788833012.402909:0:15119:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788833012.402914:0:15119:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788833012.402947:0:15119:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff984d056f8000) 00000020:00000080:3.0:1788833012.402960:0:15119:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788833012.406372:0:15119:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788833012.407156:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788833012.407163:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788833012.422468:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788833012.422484:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788833012.423124:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788833012.423132:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788833012.428133:0:15119:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788833012.429221:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788833012.429234:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788833012.431716:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788833012.431730:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788833012.450607:0:15119:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788833012.450889:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788833012.450895:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788833012.453608:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788833012.453623:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788833012.456488:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788833012.456504:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788833012.459308:0:15119:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788833012.459509:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788833012.459516:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788833012.461291:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788833012.461365:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788833012.511177:0:15119:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788833012.512479:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788833012.512487:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788833012.514096:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788833012.514109:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788833012.514575:0:15119:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788833012.514599:0:15119:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788833012.514606:0:15119:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.141@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788833012.525688:0:15119:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788833012.525726:0:15119:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.141@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788833012.525731:0:15119:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788833012.525732:0:15119:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788833012.525734:0:15119:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833012.525735:0:15119:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833012.525736:0:15119:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833012.525737:0:15119:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833012.525739:0:15119:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788833012.525740:0:15119:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833012.526283:0:15119:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788833012.526287:0:15119:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788833012.526289:0:15119:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788833012.526299:0:15119:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788833012.526300:0:15119:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833012.526301:0:15119:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833012.526302:0:15119:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833012.526303:0:15119:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833012.526304:0:15119:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788833012.526306:0:15119:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833012.526307:0:15119:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788833012.526342:0:15119:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788833012.526362:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994335232:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788833012.526502:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833012.526559:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d77900 going to sleep for 11 seconds 00000100:00100000:3.0:1788833012.526783:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994335232 00000100:00100000:3.0:1788833012.526791:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994335232 00000100:00100000:3.0:1788833012.526838:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788833012.526848:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:15119:x1875726994335232:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788833012.526885:0:14431:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788833012.526889:0:14431:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788833012.526892:0:14431:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788833012.533993:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:15119:x1875726994335232:12345-0@lo:253:mount.lustre.0 Request processed in 7139us (7484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833012.534007:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788833012.534124:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994335232:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788833012.534139:0:15119:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788833012.534142:0:15119:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788833012.534144:0:15119:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788833012.534145:0:15119:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833012.534147:0:15119:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833012.534148:0:15119:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833012.534149:0:15119:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833012.534150:0:15119:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788833012.534152:0:15119:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833012.534154:0:15119:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788833012.534176:0:15119:0:(tgt_mount.c:101:server_register_mount()) register mount ffff984d11126000 from lustre-OST0000 10000000:01000000:2.0:1788833012.534202:0:15119:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788833012.534205:0:15119:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788833012.534211:0:15119:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff984d06c33370 local copy 00010000:00010000:2.0:1788833012.534221:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8e00/0xd270a10c1c6a5b2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b32 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833012.534465:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994335360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788833012.534500:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833012.534544:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d77a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833012.534974:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994335360 00000100:00100000:0.0:1788833012.534981:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994335360 00000100:00100000:0.0:1788833012.535013:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788833012.535022:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:15119:x1875726994335360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833012.535215:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:15119:x1875726994335360:12345-0@lo:501:mount.lustre.0 Request processed in 193us (714us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788833012.535222:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788833012.535419:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994335360:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788833012.535443:0:15119:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788833012.535580:0:15119:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788833012.535588:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8e00/0xd270a10c1c6a5b2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b32 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833012.535597:0:15119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8e00/0xd270a10c1c6a5b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b32 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833012.535622:0:15119:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984d11126000 10000000:01000000:2.0:1788833012.535627:0:15119:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788833012.535631:0:15119:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff984d06c33370 10000000:01000000:2.0:1788833012.535633:0:15119:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788833012.535637:0:15119:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff984d06c33370 from 1 10000000:01000000:2.0:1788833012.535639:0:15119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788833012.535663:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b703200/0xd270a10c1c6a5c43 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833012.535671:0:15119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3b703200/0xd270a10c1c6a5c43 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833012.535680:0:15119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3b703200/0xd270a10c1c6a5c43 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833012.535696:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994335488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788833012.535727:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833012.535804:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d77a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788833012.535856:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994335488 00000100:00100000:3.0:1788833012.535861:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994335488 00000100:00100000:3.0:1788833012.535893:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788833012.535900:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+12:15119:x1875726994335488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788833012.535908:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833012.535920:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3ada3400/0xd270a10c1c6a5c4a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5c43 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.535939:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3ada3400/0xd270a10c1c6a5c4a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c43 expref: 13 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.535949:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3ada3400/0xd270a10c1c6a5c4a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c43 expref: 13 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.535957:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3400, rc 0) 00000100:00100000:3.0:1788833012.535985:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+13:15119:x1875726994335488:12345-0@lo:101:mount.lustre.0 Request processed in 86us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833012.535991:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788833012.536163:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994335488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788833012.536175:0:15119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3b703200/0xd270a10c1c6a5c43 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c4a expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833012.536192:0:15119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3b703200/0xd270a10c1c6a5c43 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5c4a expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833012.536208:0:15119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788833012.536223:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b703200/0xd270a10c1c6a5c43 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c4a expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833012.536230:0:15119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3b703200/0xd270a10c1c6a5c43 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c4a expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833012.536236:0:15119:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788833012.536240:0:15119:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788833012.536244:0:15119:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788833012.536246:0:15119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788833012.536258:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702200/0xd270a10c1c6a5c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833012.536264:0:15119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3b702200/0xd270a10c1c6a5c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833012.536272:0:15119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3b702200/0xd270a10c1c6a5c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833012.536284:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994335616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788833012.536321:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833012.536340:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d77a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788833012.536394:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994335616 00000100:00100000:3.0:1788833012.536398:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994335616 00000100:00100000:3.0:1788833012.536426:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788833012.536432:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+13:15119:x1875726994335616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788833012.536439:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833012.536447:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3ada2c00/0xd270a10c1c6a5c58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5c51 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.536472:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3ada2c00/0xd270a10c1c6a5c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c51 expref: 14 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.536479:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3ada2c00/0xd270a10c1c6a5c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c51 expref: 14 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.536486:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2c00, rc 0) 00000100:00100000:3.0:1788833012.536513:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+14:15119:x1875726994335616:12345-0@lo:101:mount.lustre.0 Request processed in 81us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833012.536519:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788833012.536716:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994335616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788833012.536727:0:15119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3b702200/0xd270a10c1c6a5c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c58 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833012.536769:0:15119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3b702200/0xd270a10c1c6a5c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5c58 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788833012.537364:0:15119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788833012.541116:0:15119:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788833012.541407:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788833012.541451:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788833012.541483:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788833012.541532:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788833012.541567:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788833012.541598:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788833012.541659:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788833012.541666:0:15119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788833012.541764:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994335744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788833012.541824:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833012.541875:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833012.542096:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994335744 00000100:00100000:3.0:1788833012.542103:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994335744 00000100:00100000:3.0:1788833012.542148:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788833012.542156:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+14:15119:x1875726994335744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788833012.542489:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+14:15119:x1875726994335744:12345-0@lo:501:mount.lustre.0 Request processed in 333us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833012.542497:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788833012.543544:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994335744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833012.543592:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994335872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788833012.543654:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833012.543698:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788833012.544183:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994335872 00000100:00100000:2.0:1788833012.544191:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994335872 00000100:00100000:2.0:1788833012.544236:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788833012.544245:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+14:15119:x1875726994335872:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788833012.545082:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+14:15119:x1875726994335872:12345-0@lo:503:mount.lustre.0 Request processed in 835us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833012.545091:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788833012.545206:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994335872:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788833012.545980:0:15119:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788833012.546060:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833012.546107:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833012.546255:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788833012.546652:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994336000 00000100:00100000:1.0:1788833012.546659:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994336000 00000100:00100000:1.0:1788833012.546706:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788833012.546715:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+14:15119:x1875726994336000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833012.546977:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+14:15119:x1875726994336000:12345-0@lo:502:mount.lustre.0 Request processed in 262us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833012.546994:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788833012.547168:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788833012.547426:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788833012.547474:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788833012.547504:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788833012.547547:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788833012.547584:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788833012.547618:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788833012.547664:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788833012.547712:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788833012.547948:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788833012.547999:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788833012.548030:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788833012.548091:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788833012.548122:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833012.548167:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833012.548244:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788833012.548634:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994336128 00000100:00100000:2.0:1788833012.548641:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994336128 00000100:00100000:3.0:1788833012.548774:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788833012.548783:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+14:15119:x1875726994336128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788833012.548968:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+14:15119:x1875726994336128:12345-0@lo:502:mount.lustre.0 Request processed in 185us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833012.548975:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788833012.549155:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788833012.549234:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788833012.549245:0:15119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788833012.550349:0:15134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788833012.550364:0:15134:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788833012.550370:0:15134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833012.550372:0:15134:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788833012.550507:0:15134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788833012.550521:0:15134:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff984d06430000) 00000020:00000080:0.0:1788833012.550541:0:15134:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788833012.550547:0:15134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788833012.550607:0:15134:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984d11126000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788833012.550615:0:15134:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788833012.550621:0:15134:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd270a10c1c6a5c66 00010000:00010000:0.0:1788833012.561719:0:15134:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788833012.562183:0:15134:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788833012.573664:0:15134:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788833012.578218:0:15134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788833012.578229:0:15134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833012.578235:0:15134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833012.578237:0:15134:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788833012.578240:0:15134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788833012.578242:0:15134:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788833012.578244:0:15134:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788833012.578246:0:15134:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788833012.578247:0:15134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788833012.578249:0:15134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833012.578251:0:15134:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788833012.578253:0:15134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788833012.578255:0:15134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833012.578257:0:15134:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788833012.578259:0:15134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788833012.578261:0:15134:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788833012.578264:0:15134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833012.578266:0:15134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833012.578267:0:15134:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788833012.578269:0:15134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788833012.578272:0:15134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833012.578273:0:15134:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788833012.578277:0:15134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788833012.578333:0:15134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833012.578337:0:15134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833012.578339:0:15134:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788833012.578342:0:15134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788833012.584654:0:15119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788833012.584700:0:15119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788833012.584767:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702200/0xd270a10c1c6a5c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c58 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833012.584794:0:15119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3b702200/0xd270a10c1c6a5c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c58 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833012.584803:0:15119:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d11126000 from 1 10000000:01000000:2.0:1788833012.584806:0:15119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788833012.584840:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833012.584848:0:15119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833012.584858:0:15119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833012.584882:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336256:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788833012.584940:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833012.584981:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d773c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833012.586186:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994336256 00000100:00100000:3.0:1788833012.586198:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994336256 00000100:00100000:3.0:1788833012.586246:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788833012.586257:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+14:15119:x1875726994336256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788833012.586278:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833012.586293:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3ada2200/0xd270a10c1c6a5c74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5c6d expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.586319:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3ada2200/0xd270a10c1c6a5c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c6d expref: 15 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.586330:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3ada2200/0xd270a10c1c6a5c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c6d expref: 15 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.586339:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2200, rc 0) 00000100:00100000:3.0:1788833012.586405:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+15:15119:x1875726994336256:12345-0@lo:101:mount.lustre.0 Request processed in 150us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833012.586412:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788833012.587681:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788833012.587708:0:15119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c74 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.587719:0:15119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5c74 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788833012.588271:0:15119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788833012.588890:0:15119:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788833012.589145:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788833012.589197:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788833012.590621:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788833012.590639:0:15119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788833012.590873:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788833012.590940:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833012.590976:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d0c3e8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788833012.591056:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994336384 00000100:00100000:1.0:1788833012.591062:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994336384 00000100:00100000:1.0:1788833012.591100:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788833012.591108:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+15:15119:x1875726994336384:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833012.591330:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+15:15119:x1875726994336384:12345-0@lo:501:mount.lustre.0 Request processed in 221us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833012.591338:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788833012.591437:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833012.591470:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336512:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788833012.591508:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833012.591530:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788833012.591702:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994336512 00000100:00100000:1.0:1788833012.591706:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994336512 00000100:00100000:1.0:1788833012.591739:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788833012.591768:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+15:15119:x1875726994336512:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788833012.591901:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+15:15119:x1875726994336512:12345-0@lo:503:mount.lustre.0 Request processed in 132us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833012.591908:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788833012.592118:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336512:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788833012.594027:0:15119:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788833012.594120:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833012.594186:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833012.594270:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788833012.594314:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994336640 00000100:00100000:3.0:1788833012.594322:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994336640 00000100:00100000:3.0:1788833012.594532:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788833012.594543:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+15:15119:x1875726994336640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788833012.594722:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+15:15119:x1875726994336640:12345-0@lo:502:mount.lustre.0 Request processed in 180us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833012.594729:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788833012.594862:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788833012.595144:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788833012.595197:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788833012.595254:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788833012.595294:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788833012.595331:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788833012.595393:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788833012.595445:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788833012.595480:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788833012.595504:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833012.595545:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833012.595928:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06b93b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833012.596010:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994336768 00000100:00100000:2.0:1788833012.596017:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994336768 00000100:00100000:2.0:1788833012.596059:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788833012.596067:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+15:15119:x1875726994336768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788833012.596242:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+15:15119:x1875726994336768:12345-0@lo:502:mount.lustre.0 Request processed in 175us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833012.596250:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788833012.596331:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788833012.596566:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788833012.596577:0:15119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788833012.598138:0:15138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833012.598149:0:15138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833012.598152:0:15138:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788833012.598157:0:15138:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984d11126000 00000020:00000080:2.0:1788833012.598172:0:15138:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788833012.598180:0:15138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833012.598183:0:15138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833012.598184:0:15138:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788833012.598186:0:15138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833012.598189:0:15138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833012.598191:0:15138:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788833012.598194:0:15138:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984d11126000 00000020:00000080:2.0:1788833012.598196:0:15138:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788833012.598348:0:15138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833012.598352:0:15138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833012.598354:0:15138:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788833012.598356:0:15138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788833012.598359:0:15138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833012.598360:0:15138:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788833012.598364:0:15138:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984d11126000 00000020:00000080:2.0:1788833012.598365:0:15138:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788833012.601809:0:15138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788833012.601820:0:15138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788833012.601822:0:15138:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788833012.601826:0:15138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788833012.602346:0:15119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788833012.602388:0:15119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788833012.607381:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c74 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.607398:0:15119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c74 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833012.607473:0:15119:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788833012.607476:0:15119:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984d11126000 10000000:01000000:3.0:1788833012.607480:0:15119:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984d11126000 10000000:01000000:3.0:1788833012.607484:0:15119:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788833012.607490:0:15119:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984d11126000 from 1 10000000:01000000:3.0:1788833012.607493:0:15119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788833012.607527:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.607535:0:15119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.607557:0:15119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833012.607581:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788833012.607735:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833012.608407:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac83000 going to sleep for 11 seconds 00000100:00100000:0.0:1788833012.611322:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994336896 00000100:00100000:0.0:1788833012.611335:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994336896 00000100:00100000:0.0:1788833012.613388:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788833012.613404:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+15:15119:x1875726994336896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788833012.613421:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833012.613437:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d036bba00/0xd270a10c1c6a5c82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5c7b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833012.613464:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d036bba00/0xd270a10c1c6a5c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c7b expref: 16 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833012.613475:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d036bba00/0xd270a10c1c6a5c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c7b expref: 16 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833012.613490:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bba00, rc 0) 00000100:00100000:3.0:1788833012.613590:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994336896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788833012.613665:0:15119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c82 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.613675:0:15119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5c82 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833012.613717:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15119:x1875726994336896:12345-0@lo:101:mount.lustre.0 Request processed in 317us (5981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833012.613724:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000040:00080000:3.0:1788833012.614990:0:15119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788833012.615423:0:15119:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788833012.615926:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788833012.615971:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788833012.616000:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788833012.616204:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788833012.616245:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788833012.616293:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788833012.616329:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788833012.616360:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788833012.616405:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788833012.616440:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788833012.616473:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788833012.616522:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788833012.616557:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788833012.621368:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788833012.621526:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788833012.621564:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788833012.621595:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788833012.621637:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788833012.621669:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788833012.621694:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788833012.621732:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788833012.621783:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788833012.621818:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788833012.621863:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788833012.621895:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788833012.621924:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788833012.621965:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788833012.622000:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788833012.622093:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788833012.622101:0:15119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788833012.622193:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994337024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788833012.622418:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833012.622461:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac83000 going to sleep for 11 seconds 00000100:00100000:3.0:1788833012.622820:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994337024 00000100:00100000:3.0:1788833012.622827:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994337024 00000100:00100000:3.0:1788833012.622870:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788833012.622879:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15119:x1875726994337024:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788833012.623105:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15119:x1875726994337024:12345-0@lo:501:mount.lustre.0 Request processed in 226us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833012.623113:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788833012.623166:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994337024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788833012.623201:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994337152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788833012.623234:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833012.623264:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac83000 going to sleep for 11 seconds 00000100:00100000:0.0:1788833012.624803:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994337152 00000100:00100000:0.0:1788833012.624814:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994337152 00000100:00100000:0.0:1788833012.624856:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788833012.624864:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15119:x1875726994337152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788833012.625069:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15119:x1875726994337152:12345-0@lo:503:mount.lustre.0 Request processed in 205us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833012.625077:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788833012.625129:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994337152:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788833012.625792:0:15119:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788833012.625861:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994337280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833012.625906:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833012.625947:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3aeb7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788833012.625994:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994337280 00000100:00100000:3.0:1788833012.626000:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994337280 00000100:00100000:3.0:1788833012.626041:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788833012.626050:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15119:x1875726994337280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788833012.626227:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15119:x1875726994337280:12345-0@lo:502:mount.lustre.0 Request processed in 177us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833012.626235:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788833012.626251:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994337280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788833012.626608:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788833012.626658:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788833012.626709:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788833012.626786:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788833012.626825:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788833012.626872:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788833012.630714:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788833012.630832:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788833012.630909:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788833012.630949:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788833012.630984:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788833012.631045:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788833012.631086:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788833012.631119:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788833012.631162:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788833012.631192:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788833012.631219:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788833012.631257:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788833012.631306:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788833012.631335:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788833012.632536:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788833012.632617:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788833012.632657:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788833012.632730:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788833012.633369:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788833012.633564:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788833012.633638:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788833012.633678:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788833012.633727:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788833012.634170:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788833012.634207:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788833012.634247:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788833012.634281:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788833012.634327:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788833012.635513:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788833012.635616:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788833012.635654:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788833012.636588:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788833012.636670:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788833012.636707:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788833012.636859:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994337408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833012.636942:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833012.636992:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06b93300 going to sleep for 11 seconds 00000100:00100000:3.0:1788833012.637286:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994337408 00000100:00100000:3.0:1788833012.637294:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994337408 00000100:00100000:3.0:1788833012.637374:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788833012.637393:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15119:x1875726994337408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788833012.637828:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15119:x1875726994337408:12345-0@lo:502:mount.lustre.0 Request processed in 436us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833012.637837:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788833012.637942:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994337408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788833012.638030:0:15119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788833012.638053:0:15119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788833012.640258:0:15143:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788833012.640274:0:15143:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff984d06480000) 00000020:00000080:1.0:1788833012.640294:0:15143:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788833012.640472:0:15143:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984d11126000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788833012.640476:0:15143:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984d11126000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788833012.640479:0:15143:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984d11126000 3 00010000:00080000:1.0:1788833012.640505:0:15143:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984d3bd30800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.141@tcp at head 00010000:00010000:1.0:1788833012.644086:0:15143:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788833012.644328:0:15143:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788833012.644365:0:15143:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788833012.644832:0:15143:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd270a10c1c6a5c90 00000100:00080000:1.0:1788833012.644843:0:15143:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788833012.644858:0:15143:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff984d3bd30800 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:1.0:1788833012.644891:0:15143:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984d3b37f800 x1875726994337536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788833012.644914:0:15143:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788833012.645057:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875726994337536:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788833012.645120:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833012.646801:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994337536 00000100:00100000:2.0:1788833012.646812:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994337536 00000100:00100000:2.0:1788833012.646847:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788833012.646854:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875726994337536:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788833012.646878:0:14439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1788833012.646921:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd270a10c1c6a5c97 00000004:00100000:2.0:1788833012.646936:0:14439:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788833012.646964:0:14439:0:(import.c:65:import_set_state_nolock()) ffff984d08b22000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788833012.647027:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875726994337536:12345-0@lo:38:llog_process_th.0 Request processed in 172us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833012.647054:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788833012.647100:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff984d3b37f800 x1875726994337536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788833022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833012.647111:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788833012.647118:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788833012.647126:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788833012.647131:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788833012.647133:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d3bd30800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788833012.647139:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875726994337536:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788833012.647474:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788833012.647480:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788833012.647483:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788833012.647485:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788833012.647550:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994337664:0@lo:400:kworker.0 00000100:00100000:1.0:1788833012.647588:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788833012.649865:0:15143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788833012.650003:0:15119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788833012.650046:0:15119:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788833012.650071:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c82 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.650083:0:15119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3ada2600/0xd270a10c1c6a5c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5c82 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788833012.650128:0:15119:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788833012.650130:0:15119:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788833012.650132:0:15119:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788833012.650137:0:15119:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788833012.650138:0:15119:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788833012.650140:0:15119:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788833012.650141:0:15119:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788833012.650142:0:15119:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788833012.650143:0:15119:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788833012.650147:0:15119:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788833012.650149:0:15119:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788833012.650150:0:15119:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788833012.650151:0:15119:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788833012.650152:0:15119:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788833012.650153:0:15119:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788833012.650154:0:15119:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788833012.650156:0:15119:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788833012.650157:0:15119:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788833012.650157:0:15119:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788833012.650177:0:15119:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788833012.650193:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994337792:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788833012.650250:0:15119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833012.650287:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac830c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833012.650309:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994337792 00000100:00100000:3.0:1788833012.650315:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994337792 00000100:00100000:3.0:1788833012.650353:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788833012.650361:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15119:x1875726994337792:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788833012.650410:0:14431:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788833012.650423:0:14431:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788833012.651788:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994337664 00000100:00100000:1.0:1788833012.651799:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994337664 00000100:00100000:1.0:1788833012.651836:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788833012.651844:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994337664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833012.651910:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994337664:12345-0@lo:400:kworker.0 Request processed in 66us (4320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833012.651917:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788833012.651965:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff984c04ba4e00 x1875726994337664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833012.651979:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994337664:0@lo:400:kworker.0 20000000:01000000:0.0:1788833012.679319:0:14431:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788833012.679335:0:14431:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788833012.679400:0:14453:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788833012.679406:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788833012.679426:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833012.679445:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d3b7d9600/0xd270a10c1c6a5c0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c04 expref: 16 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833012.679460:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833012.679498:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d3b7d9600/0xd270a10c1c6a5c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a5c04 expref: 16 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833012.679525:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d3b7d9600/0xd270a10c1c6a5c0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a5c04 expref: 16 pid: 14430 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833012.679540:0:14453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1875726994337920:0@lo:104: 00000100:00100000:1.0:1788833012.679605:0:14453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833012.679658:0:14453:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3ac9f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833012.679780:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994337920 00000100:00100000:0.0:1788833012.679788:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994337920 00000100:00100000:0.0:1788833012.679828:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788833012.679835:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:14453:x1875726994337920:12345-0@lo:104: 00010000:00010000:0.0:1788833012.679846:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5c0b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833012.679908:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788833012.679914:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:14453:x1875726994337920:12345-0@lo:104: Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833012.679922:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788833012.679926:0:14453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1875726994337920:0@lo:104: 00010000:00010000:1.0:1788833012.679946:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.679989:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833012.679997:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5c0b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680006:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb800 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:3.0:1788833012.680010:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a5c0b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680028:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a5c0b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788833012.680045:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a5c0b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833012.680051:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788833012.680076:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5c0b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680082:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788833012.680110:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5c0b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680117:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d036bb800/0xd270a10c1c6a5c04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5c0b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680133:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833012.680135:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833012.680138:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833012.680138:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3316:1875726994338048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788833012.680167:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833012.680249:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994338048 00000100:00100000:3.0:1788833012.680254:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994338048 00010000:00010000:3.0:1788833012.680272:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d3b7d9600/0xd270a10c1c6a5c0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5c04 expref: 17 pid: 14430 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833012.680305:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788833012.680312:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:3316:x1875726994338048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788833012.680320:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833012.680325:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d3b7d9600/0xd270a10c1c6a5c0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5c04 expref: 17 pid: 14430 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680342:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d3b7d9600/0xd270a10c1c6a5c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a5c04 expref: 17 pid: 14430 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680354:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b7d9600/0xd270a10c1c6a5c0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a5c04 expref: 17 pid: 14430 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680365:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680373:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788833012.680392:0:14424:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007966853s 00010000:00010000:3.0:1788833012.680396:0:14424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680403:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680410:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680416:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680421:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d9400 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833012.680425:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680432:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680460:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833012.680469:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833012.680489:0:14453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833012.680498:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833012.680501:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:3316:x1875726994338048:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (333us total) trans 0 rc 0/0 00010000:00010000:0.0:1788833012.680512:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b7d9400/0xd270a10c1c6a5c9e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833012.680517:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788833012.680642:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3316:1875726994338048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788833012.684818:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+15:15119:x1875726994337792:12345-0@lo:253:mount.lustre.0 Request processed in 34448us (34558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833012.684831:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788833012.684978:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15119:1875726994337792:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788833012.684992:0:15119:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788833012.684995:0:15119:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788833012.684997:0:15119:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788833012.684998:0:15119:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788833012.684999:0:15119:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788833012.685000:0:15119:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788833012.685002:0:15119:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788833012.685003:0:15119:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788833012.685005:0:15119:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788833012.685007:0:15119:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788833012.685019:0:15119:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788833012.696697:0:15119:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788833012.698063:0:15119:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788833012.700600:0:15119:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788833012.700849:0:15119:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788833012.701005:0:15119:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788833012.701542:0:15119:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788833012.702185:0:15119:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788833012.763907:0:15119:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788833012.763915:0:15119:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788833012.763948:0:15119:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788833012.764000:0:15119:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788833012.764013:0:15119:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788833012.764052:0:15119:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788833013.019186:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833014.038019:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788833014.102322:0:14434:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788833014.102330:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984d1198f000 from 7 10000000:01000000:3.0:1788833014.102335:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788833014.102376:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833014.102388:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833014.102399:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833014.102436:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994338176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788833014.102496:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833014.102550:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833014.102636:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994338176 00000100:00100000:1.0:1788833014.102642:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994338176 00000100:00100000:1.0:1788833014.102694:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788833014.102701:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+15:14434:x1875726994338176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833014.102712:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833014.102724:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b7d8400/0xd270a10c1c6a5cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5ca5 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833014.102773:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b7d8400/0xd270a10c1c6a5cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5ca5 expref: 16 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833014.102783:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b7d8400/0xd270a10c1c6a5cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5ca5 expref: 16 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833014.102797:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b7d8400, rc 0) 00000100:00100000:1.0:1788833014.102835:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:14434:x1875726994338176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833014.102842:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788833014.103102:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994338176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788833014.103116:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5cac expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833014.103125:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5cac expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833014.103173:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994338304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788833014.103215:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833014.103236:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833014.103393:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994338304 00000100:00100000:1.0:1788833014.103398:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994338304 00000100:00100000:1.0:1788833014.103431:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788833014.103438:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:14434:x1875726994338304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788833014.103452:0:14431:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788833014.103467:0:14431:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788833014.103470:0:14431:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788833014.103547:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:14434:x1875726994338304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833014.103554:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788833014.103707:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994338304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788833014.103787:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788833014.103794:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5cac expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833014.103802:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5cac expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833015.061924:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833016.088781:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833017.113344:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788833018.007828:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788833018.007834:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788833018.007837:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788833018.007840:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788833018.007896:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3317:1875726994338432:0@lo:400:kworker.0 00000100:00100000:1.0:1788833018.007960:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833018.008041:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994338560:0@lo:400:kworker.0 00000100:00100000:1.0:1788833018.008070:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833018.008110:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833018.008117:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994338688:0@lo:400:kworker.0 00000100:00100000:1.0:1788833018.008144:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833018.008164:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994338560 00000100:00100000:1.0:1788833018.008169:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994338432 00000100:00100000:3.0:1788833018.008171:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994338560 00000100:00100000:1.0:1788833018.008172:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994338432 00000100:00100000:3.0:1788833018.008203:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994338688 00000100:00100000:3.0:1788833018.008206:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994338688 00000100:00100000:1.0:1788833018.008207:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788833018.008214:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:3317:x1875726994338432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833018.008243:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788833018.008257:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994338560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833018.008258:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:3317:x1875726994338432:12345-0@lo:400:kworker.0 Request processed in 44us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833018.008265:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788833018.008294:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875726994338560:12345-0@lo:400:kworker.0 Request processed in 38us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833018.008294:0:14438:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788833018.008300:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788833018.008300:0:14438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788833018.008313:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788833018.008319:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994338688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833018.008346:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994338688:12345-0@lo:400:kworker.0 Request processed in 27us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833018.008351:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788833018.008377:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788833018.008399:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3b37e300 x1875726994338688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833018.008414:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994338688:0@lo:400:kworker.0 00010000:00080000:3.0:1788833018.008424:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3b37ea00 x1875726994338560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833018.008433:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875726994338560:0@lo:400:kworker.0 00000100:00100000:0.0:1788833018.008792:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3317:1875726994338432:0@lo:400:kworker.0 00010000:00010000:3.0:1788833018.136181:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788833018.143349:0:15488:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788833019.166540:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833020.181967:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833021.208393:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788833021.663292:0:14470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788833022.230127:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788833023.128538:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788833023.128544:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788833023.128547:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788833023.128561:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788833023.128734:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3316:1875726994338816:0@lo:400:kworker.0 00000100:00100000:1.0:1788833023.128856:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833023.128908:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788833023.128916:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994338944:0@lo:400:kworker.0 00000100:00100000:1.0:1788833023.128942:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833023.128964:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788833023.128971:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875726994339072:0@lo:400:kworker.0 00000100:00100000:3.0:1788833023.129226:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994338816 00000100:00100000:3.0:1788833023.129235:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994338816 00000100:00100000:3.0:1788833023.129275:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788833023.129284:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:3316:x1875726994338816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833023.129504:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833023.129712:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:3316:x1875726994338816:12345-0@lo:400:kworker.0 Request processed in 428us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833023.129725:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788833023.129776:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994338944 00000100:00100000:3.0:1788833023.129781:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994338944 00000100:00100000:3.0:1788833023.129807:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994339072 00000100:00100000:3.0:1788833023.129810:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994339072 00000100:00100000:3.0:1788833023.129836:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788833023.129842:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994338944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833023.129876:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994338944:12345-0@lo:400:kworker.0 Request processed in 33us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833023.129883:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788833023.129895:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788833023.129901:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875726994339072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833023.129932:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875726994339072:12345-0@lo:400:kworker.0 Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833023.129938:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788833023.129972:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984c04ba6a00 x1875726994338944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833023.129996:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994338944:0@lo:400:kworker.0 00000100:00100000:3.0:1788833023.130470:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3316:1875726994338816:0@lo:400:kworker.0 00000100:00080000:3.0:1788833023.130501:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788833023.130519:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984c04ba5f80 x1875726994339072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833023.130530:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875726994339072:0@lo:400:kworker.0 00010000:00010000:1.0:1788833023.260930:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833023.897392:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788833008/real 1788833008] req@ffff984d3aa3e680 x1875726994334336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833023 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833023.897423:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984d3aa3e680 x1875726994334336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833023 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788833023.897443:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d031b3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788833023.897455:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788833023.897459:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994334336:0@lo:8:kworker.0 00000100:00080000:0.0:1788833023.897611:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788833023.897616:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788833023.897619:0:8:0:(import.c:65:import_set_state_nolock()) ffff984d031b3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788833023.897624:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:0.0:1788833023.897628:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788833023.897633:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff984d031b3000 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:0.0:1788833023.897651:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984c04ba5500 x1875726994339328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788833023.897778:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833023.897791:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3314:1875726994339200:0@lo:400:kworker.0 00000100:00100000:1.0:1788833023.897850:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833023.898018:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994339200 00000100:00100000:2.0:1788833023.898025:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994339200 00000100:00100000:2.0:1788833023.898073:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788833023.898090:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:3314:x1875726994339200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833023.898138:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:3314:x1875726994339200:12345-0@lo:400:kworker.0 Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833023.898146:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788833023.898223:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3314:1875726994339200:0@lo:400:kworker.0 00000100:00080000:0.0:1788833023.898293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788833023.898297:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788833023.898342:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994339584:0@lo:400:kworker.0 00000100:00100000:0.0:1788833023.898378:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833023.898401:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788833023.898407:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994339456:0@lo:400:kworker.0 00000100:00100000:0.0:1788833023.898428:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833023.898516:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994339328:0@lo:8:kworker.0 00000100:00100000:2.0:1788833023.898588:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833023.898931:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994339328 00000100:00100000:0.0:1788833023.898937:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994339328 00000100:00100000:3.0:1788833023.899037:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994339584 00000100:00100000:3.0:1788833023.899042:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994339584 00000100:00100000:3.0:1788833023.899071:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994339456 00000100:00100000:3.0:1788833023.899074:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994339456 00000100:00100000:3.0:1788833023.899094:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788833023.899101:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994339584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833023.899147:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994339584:12345-0@lo:400:kworker.0 Request processed in 46us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833023.899153:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788833023.899168:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788833023.899174:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994339456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833023.899199:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994339456:12345-0@lo:400:kworker.0 Request processed in 26us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833023.899205:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788833023.899240:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984c04ba6680 x1875726994339456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833023.899252:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994339456:0@lo:400:kworker.0 00010000:00080000:3.0:1788833023.899262:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984c04ba6d80 x1875726994339584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833023.899286:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994339584:0@lo:400:kworker.0 00000100:00100000:0.0:1788833023.899333:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788833023.899338:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1875726994339328:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788833023.899359:0:15121:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:0.0:1788833023.899383:0:15121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd270a10c1c6a5cb3 00002000:00100000:0.0:1788833023.899395:0:15121:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff984d3988c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788833023.899400:0:15121:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788833023.899409:0:15121:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788833023.899714:0:15121:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788833023.899736:0:15121:0:(import.c:65:import_set_state_nolock()) ffff984d3988c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788833023.899934:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875726994339328:12345-0@lo:8:kworker.0 Request processed in 594us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833023.899942:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788833023.900012:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984c04ba5500 x1875726994339328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788833043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833023.900022:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788833023.900028:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788833023.900034:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788833023.900039:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788833023.900041:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d031b3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788833023.900054:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788833023.900059:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994339328:0@lo:8:kworker.0 00000004:00080000:3.0:1788833023.900104:0:14460:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788833023.900121:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1875726994339840:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788833023.900149:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833023.900224:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994339712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788833023.900253:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833023.900293:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994339712 00000100:00100000:2.0:1788833023.900298:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994339712 00000100:00100000:2.0:1788833023.900333:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788833023.900340:0:15125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875726994339712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788833023.900362:0:15125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833023.900397:0:15125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875726994339712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833023.900403:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788833023.900431:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3aa3e680 x1875726994339712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833023.900444:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994339712:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788833023.900472:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833023.901725:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10ffc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833023.901970:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994339840 00000100:00100000:1.0:1788833023.901987:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994339840 00000100:00100000:1.0:1788833023.902038:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788833023.902046:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14460:x1875726994339840:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788833023.907148:0:15123:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788833023.907158:0:15123:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788833023.907163:0:15123:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000004:00080000:0.0:1788833023.907600:0:14459:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788833023.909073:0:14459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 527599327030ns, next at 0ns, rc = 0 00002000:00010000:1.0:1788833023.927008:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.927021:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba545119/0xd270a10c1c6a5cba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.927037:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.928178:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.928187:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba545119/0xd270a10c1c6a5cba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.928208:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba545119/0xd270a10c1c6a5cba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.928220:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba545119/0xd270a10c1c6a5cba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.928228:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba545119/0xd270a10c1c6a5cba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.928250:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833023.928306:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833023.928314:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba545119/0xd270a10c1c6a5cba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.928324:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d9a00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788833023.928335:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba545119/0xd270a10c1c6a5cba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.928346:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba545119/0xd270a10c1c6a5cba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.928365:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba545119/0xd270a10c1c6a5cba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.928372:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba545119/0xd270a10c1c6a5cba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.928394:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833023.928396:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833023.928398:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833023.930176:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.930188:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c1b67ca/0xd270a10c1c6a5cc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.930214:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.930219:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.930226:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c1b67ca/0xd270a10c1c6a5cc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.930239:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c1b67ca/0xd270a10c1c6a5cc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.930249:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c1b67ca/0xd270a10c1c6a5cc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.930256:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c1b67ca/0xd270a10c1c6a5cc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.930275:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833023.930288:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833023.930294:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c1b67ca/0xd270a10c1c6a5cc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.930302:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d9600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.930369:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c1b67ca/0xd270a10c1c6a5cc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.930380:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c1b67ca/0xd270a10c1c6a5cc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.930410:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c1b67ca/0xd270a10c1c6a5cc1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.930418:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c1b67ca/0xd270a10c1c6a5cc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.930511:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.930514:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.930517:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833023.937106:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.937120:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964f81fb/0xd270a10c1c6a5cc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937137:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.937142:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.937148:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964f81fb/0xd270a10c1c6a5cc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937162:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000964f81fb/0xd270a10c1c6a5cc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937172:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964f81fb/0xd270a10c1c6a5cc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937178:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000964f81fb/0xd270a10c1c6a5cc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937215:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833023.937228:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833023.937233:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000964f81fb/0xd270a10c1c6a5cc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937240:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d9400 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.937244:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000964f81fb/0xd270a10c1c6a5cc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937253:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000964f81fb/0xd270a10c1c6a5cc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937268:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000964f81fb/0xd270a10c1c6a5cc8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937275:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000964f81fb/0xd270a10c1c6a5cc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937290:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.937292:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.937293:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833023.937795:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.937802:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c202aca/0xd270a10c1c6a5ccf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937811:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.937820:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.937825:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c202aca/0xd270a10c1c6a5ccf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937835:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c202aca/0xd270a10c1c6a5ccf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937842:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c202aca/0xd270a10c1c6a5ccf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937849:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c202aca/0xd270a10c1c6a5ccf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937864:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833023.937873:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833023.937876:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c202aca/0xd270a10c1c6a5ccf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937882:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d8a00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.937885:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c202aca/0xd270a10c1c6a5ccf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937891:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c202aca/0xd270a10c1c6a5ccf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937901:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c202aca/0xd270a10c1c6a5ccf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937917:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c202aca/0xd270a10c1c6a5ccf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.937930:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.937932:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.937934:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833023.940966:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.940988:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e072e303/0xd270a10c1c6a5cd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.941501:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.941506:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.941513:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e072e303/0xd270a10c1c6a5cd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.941527:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e072e303/0xd270a10c1c6a5cd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.941537:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e072e303/0xd270a10c1c6a5cd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.941545:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e072e303/0xd270a10c1c6a5cd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.941563:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833023.941574:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833023.941585:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e072e303/0xd270a10c1c6a5cd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.941592:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d9000 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.941596:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e072e303/0xd270a10c1c6a5cd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.941604:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e072e303/0xd270a10c1c6a5cd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.941619:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e072e303/0xd270a10c1c6a5cd6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.941627:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e072e303/0xd270a10c1c6a5cd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.941646:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.941648:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.941650:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833023.944156:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.944170:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747bff04/0xd270a10c1c6a5cdd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.944186:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.944191:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.944196:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000747bff04/0xd270a10c1c6a5cdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.944224:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000747bff04/0xd270a10c1c6a5cdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.944234:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747bff04/0xd270a10c1c6a5cdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.944241:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000747bff04/0xd270a10c1c6a5cdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.944258:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833023.944269:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833023.944274:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000747bff04/0xd270a10c1c6a5cdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.944281:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d9200 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.944285:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000747bff04/0xd270a10c1c6a5cdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.944293:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000747bff04/0xd270a10c1c6a5cdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.944365:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000747bff04/0xd270a10c1c6a5cdd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.944374:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000747bff04/0xd270a10c1c6a5cdd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.944400:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.944401:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.944403:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833023.945128:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.945135:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a2665e1/0xd270a10c1c6a5ce4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.945145:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.945149:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.945153:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a2665e1/0xd270a10c1c6a5ce4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.945164:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a2665e1/0xd270a10c1c6a5ce4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.945173:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a2665e1/0xd270a10c1c6a5ce4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.945180:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a2665e1/0xd270a10c1c6a5ce4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.945196:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833023.945206:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833023.945210:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a2665e1/0xd270a10c1c6a5ce4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.945228:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d9c00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.945232:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a2665e1/0xd270a10c1c6a5ce4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.945240:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a2665e1/0xd270a10c1c6a5ce4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.945253:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a2665e1/0xd270a10c1c6a5ce4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.945260:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a2665e1/0xd270a10c1c6a5ce4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.945276:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.945278:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.945279:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833023.949624:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.949636:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c142e62/0xd270a10c1c6a5ceb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.949653:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.949657:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.949663:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c142e62/0xd270a10c1c6a5ceb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.949677:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c142e62/0xd270a10c1c6a5ceb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.951243:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c142e62/0xd270a10c1c6a5ceb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.951255:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c142e62/0xd270a10c1c6a5ceb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.951283:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833023.951300:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833023.952547:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c142e62/0xd270a10c1c6a5ceb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.952563:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d8800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.952568:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c142e62/0xd270a10c1c6a5ceb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.952578:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c142e62/0xd270a10c1c6a5ceb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.952597:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c142e62/0xd270a10c1c6a5ceb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.952604:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c142e62/0xd270a10c1c6a5ceb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.952635:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.952651:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.952654:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833023.955186:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.955197:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117bb713/0xd270a10c1c6a5cf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.955211:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.955216:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.955222:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000117bb713/0xd270a10c1c6a5cf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.955234:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000117bb713/0xd270a10c1c6a5cf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.955243:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117bb713/0xd270a10c1c6a5cf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.955250:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000117bb713/0xd270a10c1c6a5cf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.955273:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833023.955288:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833023.955294:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000117bb713/0xd270a10c1c6a5cf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.955302:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d8000 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.955318:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000117bb713/0xd270a10c1c6a5cf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.955340:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000117bb713/0xd270a10c1c6a5cf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.955356:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000117bb713/0xd270a10c1c6a5cf2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.955363:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000117bb713/0xd270a10c1c6a5cf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.955382:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.955384:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.955386:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833023.960661:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.960675:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff238e90/0xd270a10c1c6a5cf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.961560:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.961567:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.961575:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff238e90/0xd270a10c1c6a5cf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.961591:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff238e90/0xd270a10c1c6a5cf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.961602:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff238e90/0xd270a10c1c6a5cf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.961621:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff238e90/0xd270a10c1c6a5cf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.961656:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788833023.962253:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.962259:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046e7f2a6/0xd270a10c1c6a5d00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.962268:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.962272:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.962276:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046e7f2a6/0xd270a10c1c6a5d00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.962285:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046e7f2a6/0xd270a10c1c6a5d00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.962293:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046e7f2a6/0xd270a10c1c6a5d00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.962300:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046e7f2a6/0xd270a10c1c6a5d00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.962484:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833023.962491:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff238e90/0xd270a10c1c6a5cf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.962500:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b7d8c00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833023.962505:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff238e90/0xd270a10c1c6a5cf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.962513:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff238e90/0xd270a10c1c6a5cf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.962544:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff238e90/0xd270a10c1c6a5cf9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.962551:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff238e90/0xd270a10c1c6a5cf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.962571:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.962572:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.962574:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.963238:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833023.963408:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833023.963415:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046e7f2a6/0xd270a10c1c6a5d00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.963431:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05000 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833023.963434:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046e7f2a6/0xd270a10c1c6a5d00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.963443:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046e7f2a6/0xd270a10c1c6a5d00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.963456:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046e7f2a6/0xd270a10c1c6a5d00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.963464:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046e7f2a6/0xd270a10c1c6a5d00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.963494:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.963496:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.963498:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833023.964242:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.964249:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1955c5c/0xd270a10c1c6a5d07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.964265:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.964269:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.964275:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1955c5c/0xd270a10c1c6a5d07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.964287:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1955c5c/0xd270a10c1c6a5d07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.964296:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1955c5c/0xd270a10c1c6a5d07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.964303:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1955c5c/0xd270a10c1c6a5d07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.965242:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788833023.965958:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.965966:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d54d64f/0xd270a10c1c6a5d0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.965987:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.965992:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.965997:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d54d64f/0xd270a10c1c6a5d0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966009:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d54d64f/0xd270a10c1c6a5d0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966032:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d54d64f/0xd270a10c1c6a5d0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966039:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d54d64f/0xd270a10c1c6a5d0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966061:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788833023.966078:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788833023.966083:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1955c5c/0xd270a10c1c6a5d07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966090:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05c00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.966095:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1955c5c/0xd270a10c1c6a5d07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966103:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1955c5c/0xd270a10c1c6a5d07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966118:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1955c5c/0xd270a10c1c6a5d07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966124:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1955c5c/0xd270a10c1c6a5d07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966140:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833023.966148:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d54d64f/0xd270a10c1c6a5d0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966155:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04e00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.966159:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d54d64f/0xd270a10c1c6a5d0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966166:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d54d64f/0xd270a10c1c6a5d0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966177:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d54d64f/0xd270a10c1c6a5d0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966184:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d54d64f/0xd270a10c1c6a5d0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.966198:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.966199:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.966201:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.966452:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833023.968806:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.968820:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea515a93/0xd270a10c1c6a5d15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.968834:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.968839:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.968844:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea515a93/0xd270a10c1c6a5d15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.968869:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea515a93/0xd270a10c1c6a5d15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.968879:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea515a93/0xd270a10c1c6a5d15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.968887:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea515a93/0xd270a10c1c6a5d15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.968908:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833023.970221:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833023.970231:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea515a93/0xd270a10c1c6a5d15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.970242:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04c00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833023.970247:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea515a93/0xd270a10c1c6a5d15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.970256:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea515a93/0xd270a10c1c6a5d15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.970274:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea515a93/0xd270a10c1c6a5d15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.970280:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea515a93/0xd270a10c1c6a5d15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.970302:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.970431:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.970435:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833023.970961:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833023.970970:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf34afe/0xd270a10c1c6a5d1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.970992:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=527s v=(0 0) 00010000:00010000:1.0:1788833023.970997:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833023.971002:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cf34afe/0xd270a10c1c6a5d1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.971012:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cf34afe/0xd270a10c1c6a5d1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.971021:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf34afe/0xd270a10c1c6a5d1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.971041:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cf34afe/0xd270a10c1c6a5d1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.971067:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833023.973795:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833023.973807:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cf34afe/0xd270a10c1c6a5d1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.973829:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833023.973835:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf34afe/0xd270a10c1c6a5d1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.973846:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf34afe/0xd270a10c1c6a5d1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.973866:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cf34afe/0xd270a10c1c6a5d1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.973874:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cf34afe/0xd270a10c1c6a5d1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.973903:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.973906:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.973908:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833023.980421:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833023.980435:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cd5d85/0xd270a10c1c6a5d23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.980452:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788833023.980457:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833023.980464:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053cd5d85/0xd270a10c1c6a5d23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.980478:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053cd5d85/0xd270a10c1c6a5d23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.980488:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cd5d85/0xd270a10c1c6a5d23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.980503:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053cd5d85/0xd270a10c1c6a5d23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.980529:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788833023.982389:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833023.982401:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.982415:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788833023.982420:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833023.982426:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.982437:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.982447:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.982454:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.982471:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788833023.983952:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788833023.983963:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053cd5d85/0xd270a10c1c6a5d23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.983988:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833023.983993:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cd5d85/0xd270a10c1c6a5d23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.984006:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cd5d85/0xd270a10c1c6a5d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.984033:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053cd5d85/0xd270a10c1c6a5d23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.984041:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053cd5d85/0xd270a10c1c6a5d23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.984067:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833023.984072:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.984078:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833023.984083:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.984091:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.984103:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.984110:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833023.984133:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.984135:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.984145:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.984152:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.984154:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833023.984156:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833023.984356:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833023.984364:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a5d31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.984600:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788833023.984604:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833023.984611:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a5d31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.984623:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a5d31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.984632:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a5d31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.984640:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a5d31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.984718:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788833023.985420:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833023.985428:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a5d31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.985438:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:0.0:1788833023.985442:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a5d31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.985450:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a5d31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.985465:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a5d31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.985473:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a5d31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.985488:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833023.985489:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833023.985491:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833023.988279:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833023.988290:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8c3314/0xd270a10c1c6a5d38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.988308:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788833023.988313:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833023.988318:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a8c3314/0xd270a10c1c6a5d38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.988333:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a8c3314/0xd270a10c1c6a5d38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.988355:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8c3314/0xd270a10c1c6a5d38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.988363:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a8c3314/0xd270a10c1c6a5d38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.988383:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788833023.992170:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833023.992182:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc213812/0xd270a10c1c6a5d3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.992198:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788833023.992203:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833023.992258:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc213812/0xd270a10c1c6a5d3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.992273:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc213812/0xd270a10c1c6a5d3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.992283:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc213812/0xd270a10c1c6a5d3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.992290:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc213812/0xd270a10c1c6a5d3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.992323:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788833023.993098:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833023.993105:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a5d46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.993116:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788833023.993120:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833023.993124:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a5d46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.993134:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a5d46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.993142:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a5d46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.993148:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a5d46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.993157:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788833023.993197:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788833023.993207:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a8c3314/0xd270a10c1c6a5d38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993217:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702e00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.993222:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8c3314/0xd270a10c1c6a5d38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993232:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8c3314/0xd270a10c1c6a5d38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993249:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a8c3314/0xd270a10c1c6a5d38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993256:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a8c3314/0xd270a10c1c6a5d38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993275:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788833023.993278:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc213812/0xd270a10c1c6a5d3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993296:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702000 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.993300:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc213812/0xd270a10c1c6a5d3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993308:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc213812/0xd270a10c1c6a5d3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993319:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc213812/0xd270a10c1c6a5d3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993325:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc213812/0xd270a10c1c6a5d3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993337:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833023.993341:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a5d46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993347:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703a00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.993350:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a5d46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993355:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a5d46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993363:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a5d46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993376:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f10162a3/0xd270a10c1c6a5d46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.993389:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.993391:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.993393:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833023.993765:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833023.993771:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a5d4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.993781:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788833023.993790:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833023.993795:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a5d4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.993805:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a5d4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.993814:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a5d4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.993821:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a5d4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.993841:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833023.994173:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833023.994179:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a5d4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.994187:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.994191:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a5d4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.994199:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a5d4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.994210:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a5d4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.994218:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a5d4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.994234:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.994236:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.994238:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833023.994804:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833023.995556:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833023.995565:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9a1c30f/0xd270a10c1c6a5d54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.995577:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788833023.995582:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833023.995587:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9a1c30f/0xd270a10c1c6a5d54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.995599:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9a1c30f/0xd270a10c1c6a5d54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.995608:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9a1c30f/0xd270a10c1c6a5d54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.995621:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9a1c30f/0xd270a10c1c6a5d54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.995643:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833023.995654:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833023.995661:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9a1c30f/0xd270a10c1c6a5d54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.995670:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702400 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833023.995674:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9a1c30f/0xd270a10c1c6a5d54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.995683:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9a1c30f/0xd270a10c1c6a5d54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.995709:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9a1c30f/0xd270a10c1c6a5d54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.995717:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9a1c30f/0xd270a10c1c6a5d54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833023.995734:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.995736:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833023.995738:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833023.997159:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833023.997169:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4d46840/0xd270a10c1c6a5d5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.997181:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788833023.997186:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833023.997191:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4d46840/0xd270a10c1c6a5d5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.997202:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4d46840/0xd270a10c1c6a5d5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.997735:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4d46840/0xd270a10c1c6a5d5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.997764:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4d46840/0xd270a10c1c6a5d5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.997783:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788833023.998494:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833023.998502:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4d46840/0xd270a10c1c6a5d5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.998513:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702a00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:0.0:1788833023.998518:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4d46840/0xd270a10c1c6a5d5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.998527:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4d46840/0xd270a10c1c6a5d5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.998546:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4d46840/0xd270a10c1c6a5d5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.998553:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4d46840/0xd270a10c1c6a5d5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.998571:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833023.998573:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833023.998575:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833023.999339:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833023.999349:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a5d62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.999366:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788833023.999371:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833023.999377:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a5d62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.999389:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a5d62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.999398:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a5d62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.999406:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a5d62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.999432:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788833023.999533:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833023.999539:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a5d62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.999548:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702c00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:0.0:1788833023.999551:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a5d62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.999572:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a5d62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.999586:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a5d62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.999594:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2f7fa59/0xd270a10c1c6a5d62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833023.999611:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833023.999613:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833023.999616:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833023.999917:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833023.999923:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070df58e8/0xd270a10c1c6a5d69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.999932:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788833023.999936:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833023.999940:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070df58e8/0xd270a10c1c6a5d69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833023.999950:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070df58e8/0xd270a10c1c6a5d69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.001092:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070df58e8/0xd270a10c1c6a5d69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.001099:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070df58e8/0xd270a10c1c6a5d69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788833024.001121:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788833024.001159:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788833024.001519:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833024.001528:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070df58e8/0xd270a10c1c6a5d69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833024.001538:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703000 already unused, calling callback (ffffffffc1438370) 00010000:00010000:0.0:1788833024.001543:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070df58e8/0xd270a10c1c6a5d69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833024.001553:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070df58e8/0xd270a10c1c6a5d69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833024.001571:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070df58e8/0xd270a10c1c6a5d69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833024.001590:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070df58e8/0xd270a10c1c6a5d69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833024.001609:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833024.001611:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833024.001613:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833024.003258:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833024.003268:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456f6006/0xd270a10c1c6a5d70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.003283:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788833024.003287:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833024.003292:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456f6006/0xd270a10c1c6a5d70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.003306:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456f6006/0xd270a10c1c6a5d70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.003315:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456f6006/0xd270a10c1c6a5d70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.003323:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456f6006/0xd270a10c1c6a5d70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.003360:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833024.003504:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833024.003511:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456f6006/0xd270a10c1c6a5d70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.003521:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703e00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833024.003526:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456f6006/0xd270a10c1c6a5d70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.003545:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456f6006/0xd270a10c1c6a5d70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.003562:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456f6006/0xd270a10c1c6a5d70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.003570:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456f6006/0xd270a10c1c6a5d70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.003787:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833024.003789:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833024.003791:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788833024.006608:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788833024.006620:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.006638:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1788833024.006642:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833024.006648:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.006727:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.006738:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.006766:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.006787:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788833024.007017:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788833024.007025:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833024.007035:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:0.0:1788833024.007040:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833024.007050:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833024.007067:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833024.007075:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9e3d4a8/0xd270a10c1c6a5d77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833024.007091:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833024.007093:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833024.007095:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788833024.008074:0:15123:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1788833024.008164:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14460:x1875726994339840:12345-0@lo:5:osp-pre-0-0.0 Request processed in 106115us (108010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833024.008173:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788833024.009284:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1875726994339840:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788833024.009300:0:14460:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788833024.009354:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1875726994339968:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788833024.009393:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833024.009621:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10ffc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833024.009875:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994339968 00000100:00100000:0.0:1788833024.009881:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994339968 00000100:00100000:0.0:1788833024.009923:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788833024.009931:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14460:x1875726994339968:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788833024.009971:0:15121:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788833024.031077:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14460:x1875726994339968:12345-0@lo:5:osp-pre-0-0.0 Request processed in 21137us (21675us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788833024.031093:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788833024.031150:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1875726994339968:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788833024.031165:0:14460:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788833024.277937:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788833024.708925:0:15840:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788833024.708930:0:15840:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788833024.709082:0:15840:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff984d2daa3000 00000020:01000004:3.0:1788833024.709097:0:15840:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788833024.709109:0:15840:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788833024.709121:0:15840:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff984d056fcd28) 00000020:00000080:3.0:1788833024.709136:0:15840:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788833024.724791:0:15840:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788833024.725072:0:15840:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788833024.726050:0:15840:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788833024.726266:0:15840:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788833024.726481:0:15840:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788833024.727392:0:15840:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:3.0:1788833024.728039:0:15840:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 529: rc = 0 00100000:10000000:3.0:1788833024.728311:0:15840:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 529: rc = 0 00100000:10000000:3.0:1788833024.729408:0:15840:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 666: rc = 0 00100000:10000000:3.0:1788833024.731099:0:15840:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 666: rc = 0 00100000:10000000:3.0:1788833024.731361:0:15840:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 666: rc = 0 00100000:10000000:3.0:1788833024.731962:0:15840:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 666: rc = 0 00100000:10000000:3.0:1788833024.732216:0:15840:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 666: rc = 0 00100000:10000000:3.0:1788833024.732450:0:15840:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 666: rc = 0 00000020:00000080:3.0:1788833024.733216:0:15840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788833024.733228:0:15840:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788833024.733237:0:15840:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd270a10c1c6a5d85 00000020:01000004:3.0:1788833024.733244:0:15840:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788833024.733264:0:15840:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.141@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788833024.733267:0:15840:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788833024.733273:0:15840:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788833024.733293:0:15840:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788833024.733297:0:15840:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.141@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788833024.744043:0:15840:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788833024.744082:0:15840:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.141@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788833024.744090:0:15840:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788833024.744092:0:15840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788833024.744093:0:15840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833024.744094:0:15840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833024.744095:0:15840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833024.744096:0:15840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833024.744097:0:15840:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788833024.744098:0:15840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833024.744099:0:15840:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788833024.744102:0:15840:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788833024.744104:0:15840:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788833024.744105:0:15840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788833024.744106:0:15840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833024.744107:0:15840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833024.744107:0:15840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833024.744108:0:15840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833024.744109:0:15840:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788833024.744110:0:15840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833024.744111:0:15840:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788833024.744146:0:15840:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788833024.744166:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340096:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788833024.744230:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833024.744342:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d77600 going to sleep for 11 seconds 00000100:00100000:3.0:1788833024.744513:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994340096 00000100:00100000:3.0:1788833024.744633:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994340096 00000100:00100000:3.0:1788833024.744817:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788833024.744826:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15840:x1875726994340096:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788833024.744854:0:14430:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788833024.744857:0:14430:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788833024.744860:0:14430:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788833024.770216:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15840:x1875726994340096:12345-0@lo:253:mount.lustre.0 Request processed in 25383us (25978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833024.770230:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788833024.770328:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788833024.770343:0:15840:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788833024.770346:0:15840:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788833024.770348:0:15840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788833024.770349:0:15840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788833024.770350:0:15840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788833024.770351:0:15840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788833024.770352:0:15840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788833024.770354:0:15840:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788833024.770356:0:15840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788833024.770357:0:15840:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788833024.770379:0:15840:0:(tgt_mount.c:101:server_register_mount()) register mount ffff984d2daa3000 from lustre-OST0001 10000000:01000000:2.0:1788833024.770402:0:15840:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788833024.770405:0:15840:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788833024.770425:0:15840:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff984d06c33370 local copy 00010000:00010000:2.0:1788833024.770436:0:15840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8e00/0xd270a10c1c6a5b2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b32 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833024.770679:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788833024.770716:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833024.770782:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10db20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833024.771004:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994340224 00000100:00100000:1.0:1788833024.771010:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994340224 00000100:00100000:1.0:1788833024.771057:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788833024.771066:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15840:x1875726994340224:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833024.771238:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15840:x1875726994340224:12345-0@lo:501:mount.lustre.0 Request processed in 173us (520us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788833024.771245:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788833024.771354:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340224:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788833024.771370:0:15840:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788833024.771543:0:15840:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788833024.771627:0:15840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8e00/0xd270a10c1c6a5b2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b32 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.771638:0:15840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3b7d8e00/0xd270a10c1c6a5b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5b32 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833024.771664:0:15840:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff984d2daa3000 10000000:01000000:3.0:1788833024.771669:0:15840:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788833024.771674:0:15840:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788833024.771688:0:15840:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788833024.771692:0:15840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788833024.771695:0:15840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788833024.771721:0:15840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada3200/0xd270a10c1c6a5d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.771729:0:15840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3ada3200/0xd270a10c1c6a5d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.771739:0:15840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3ada3200/0xd270a10c1c6a5d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833024.771822:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788833024.771853:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833024.771888:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d1154d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833024.775648:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994340352 00000100:00100000:1.0:1788833024.775663:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994340352 00000100:00100000:1.0:1788833024.775737:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788833024.775796:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:15840:x1875726994340352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788833024.775813:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833024.775831:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d05f05c00/0xd270a10c1c6a5d93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5d8c expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.775860:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d05f05c00/0xd270a10c1c6a5d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5d8c expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.775872:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d05f05c00/0xd270a10c1c6a5d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5d8c expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.775880:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05c00, rc 0) 00000100:00100000:1.0:1788833024.775959:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:15840:x1875726994340352:12345-0@lo:101:mount.lustre.0 Request processed in 167us (4104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833024.775967:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788833024.776014:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788833024.776033:0:15840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3ada3200/0xd270a10c1c6a5d8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5d93 expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.776044:0:15840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3ada3200/0xd270a10c1c6a5d8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5d93 expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788833024.786370:0:15840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788833024.788100:0:15840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788833024.788392:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788833024.788437:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788833024.788471:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788833024.788515:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788833024.788861:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788833024.788900:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788833024.788994:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788833024.789002:0:15840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788833024.789082:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788833024.789144:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833024.789194:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d1154d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788833024.789223:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994340480 00000100:00100000:2.0:1788833024.789232:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994340480 00000100:00100000:2.0:1788833024.789280:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788833024.789290:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:15840:x1875726994340480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788833024.789644:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:15840:x1875726994340480:12345-0@lo:501:mount.lustre.0 Request processed in 356us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833024.789653:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788833024.789807:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833024.789842:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788833024.789885:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833024.789929:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d1863a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788833024.790499:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994340608 00000100:00100000:3.0:1788833024.790506:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994340608 00000100:00100000:3.0:1788833024.790547:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788833024.790564:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:15840:x1875726994340608:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788833024.790916:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:15840:x1875726994340608:12345-0@lo:503:mount.lustre.0 Request processed in 360us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833024.790924:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788833024.791012:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340608:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788833024.791696:0:15840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788833024.791793:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788833024.791849:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833024.791985:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10db2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788833024.792017:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994340736 00000100:00100000:1.0:1788833024.792024:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994340736 00000100:00100000:1.0:1788833024.792068:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788833024.792076:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:15840:x1875726994340736:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833024.792370:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:15840:x1875726994340736:12345-0@lo:502:mount.lustre.0 Request processed in 295us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833024.792379:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788833024.793097:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340736:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788833024.793428:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788833024.793484:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788833024.793519:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788833024.793702:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788833024.793804:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788833024.793845:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788833024.793924:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788833024.793986:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788833024.794041:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788833024.794075:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788833024.794271:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833024.794315:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10db2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788833024.794343:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994340864 00000100:00100000:1.0:1788833024.794356:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994340864 00000100:00100000:1.0:1788833024.794407:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788833024.794415:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:15840:x1875726994340864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788833024.795157:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:15840:x1875726994340864:12345-0@lo:502:mount.lustre.0 Request processed in 742us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833024.795166:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788833024.795238:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788833024.795329:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788833024.795340:0:15840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788833024.797981:0:15841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788833024.797991:0:15841:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788833024.797998:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833024.798000:0:15841:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788833024.798006:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788833024.798021:0:15841:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff984d064819b8) 00000020:00000080:1.0:1788833024.798044:0:15841:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788833024.798049:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788833024.798194:0:15841:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984d2daa3000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788833024.798204:0:15841:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788833024.798212:0:15841:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd270a10c1c6a5da1 00010000:00010000:1.0:1788833024.811241:0:15841:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788833024.816019:0:15841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788833024.821675:0:15841:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788833024.824260:0:15841:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788833024.824272:0:15841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833024.824278:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833024.824280:0:15841:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788833024.824282:0:15841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788833024.824285:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833024.824286:0:15841:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788833024.824289:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788833024.824291:0:15841:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788833024.824293:0:15841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833024.824295:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833024.824305:0:15841:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788833024.824308:0:15841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788833024.824311:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833024.824312:0:15841:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788833024.824316:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788833024.824368:0:15841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788833024.824371:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788833024.824372:0:15841:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788833024.824376:0:15841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788833024.827122:0:15840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788833024.827165:0:15840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788833024.827182:0:15840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada3200/0xd270a10c1c6a5d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5d93 expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.827194:0:15840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3ada3200/0xd270a10c1c6a5d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5d93 expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833024.827234:0:15840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d2daa3000 from 1 10000000:01000000:3.0:1788833024.827931:0:15840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788833024.827983:0:15840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.827992:0:15840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.828004:0:15840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833024.828030:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788833024.829052:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833024.829922:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10c97180 going to sleep for 11 seconds 00000100:00100000:1.0:1788833024.835317:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994340992 00000100:00100000:1.0:1788833024.835331:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994340992 00000100:00100000:2.0:1788833024.835561:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788833024.835573:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:15840:x1875726994340992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788833024.835589:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833024.835615:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b702400/0xd270a10c1c6a5daf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5da8 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.835643:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b702400/0xd270a10c1c6a5daf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5da8 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.835655:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b702400/0xd270a10c1c6a5daf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5da8 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.835663:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702400, rc 0) 00000100:00100000:2.0:1788833024.835758:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:15840:x1875726994340992:12345-0@lo:101:mount.lustre.0 Request processed in 174us (7188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833024.835766:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788833024.836184:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994340992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788833024.836216:0:15840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5daf expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833024.836228:0:15840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5daf expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788833024.839738:0:15840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788833024.840218:0:15840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788833024.840436:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788833024.840482:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788833024.840552:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788833024.840560:0:15840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788833024.840627:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833024.840689:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833024.840738:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833024.840798:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994341120 00000100:00100000:1.0:1788833024.840806:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994341120 00000100:00100000:1.0:1788833024.840850:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788833024.840859:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:15840:x1875726994341120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833024.841093:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:15840:x1875726994341120:12345-0@lo:501:mount.lustre.0 Request processed in 235us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833024.841101:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788833024.841779:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833024.841818:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788833024.841868:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833024.841910:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833024.841991:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994341248 00000100:00100000:2.0:1788833024.841997:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994341248 00000100:00100000:2.0:1788833024.842043:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788833024.842052:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:15840:x1875726994341248:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788833024.842220:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:15840:x1875726994341248:12345-0@lo:503:mount.lustre.0 Request processed in 168us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833024.842229:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788833024.842374:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341248:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788833024.844221:0:15840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788833024.844306:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341376:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833024.844370:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833024.846261:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833024.848095:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994341376 00000100:00100000:0.0:1788833024.848108:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994341376 00000100:00100000:0.0:1788833024.848264:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788833024.848274:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:15840:x1875726994341376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833024.848522:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:15840:x1875726994341376:12345-0@lo:502:mount.lustre.0 Request processed in 249us (4151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833024.849322:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788833024.849426:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788833024.850299:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788833024.850389:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788833024.850485:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788833024.850773:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788833024.850818:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788833024.850880:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788833024.851660:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788833024.851723:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788833024.851780:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833024.851852:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833024.851900:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833024.851924:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994341504 00000100:00100000:0.0:1788833024.851930:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994341504 00000100:00100000:0.0:1788833024.852102:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788833024.852112:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:15840:x1875726994341504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833024.852304:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:15840:x1875726994341504:12345-0@lo:502:mount.lustre.0 Request processed in 193us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833024.852317:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788833024.852394:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341504:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788833024.852499:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788833024.852510:0:15840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788833024.857068:0:15845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788833024.857081:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833024.857083:0:15845:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788833024.857092:0:15845:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984d2daa3000 00000020:00000080:0.0:1788833024.857095:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788833024.857101:0:15845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788833024.857103:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833024.857105:0:15845:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788833024.857107:0:15845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788833024.857110:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833024.857111:0:15845:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788833024.857114:0:15845:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff984d2daa3000 00000020:00000080:0.0:1788833024.857116:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788833024.857171:0:15845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788833024.857175:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833024.857176:0:15845:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788833024.857179:0:15845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788833024.857182:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833024.857183:0:15845:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788833024.857186:0:15845:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff984d2daa3000 00000020:00000080:0.0:1788833024.857188:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788833024.857231:0:15845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788833024.857234:0:15845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788833024.857236:0:15845:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788833024.857239:0:15845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788833024.857515:0:15840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788833024.857548:0:15840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788833024.857658:0:15840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5daf expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.857671:0:15840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5daf expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788833024.857716:0:15840:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788833024.857719:0:15840:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff984d2daa3000 10000000:01000000:1.0:1788833024.857722:0:15840:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff984d2daa3000 10000000:01000000:1.0:1788833024.857726:0:15840:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788833024.857731:0:15840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff984d2daa3000 from 1 10000000:01000000:1.0:1788833024.857768:0:15840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788833024.857800:0:15840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f04200/0xd270a10c1c6a5db6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.857808:0:15840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d05f04200/0xd270a10c1c6a5db6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.857856:0:15840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d05f04200/0xd270a10c1c6a5db6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833024.857879:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788833024.857949:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833024.858002:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d1863acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833024.858816:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994341632 00000100:00100000:3.0:1788833024.858824:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994341632 00000100:00100000:3.0:1788833024.858876:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788833024.858885:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:15840:x1875726994341632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788833024.858910:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833024.858924:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3ada3000/0xd270a10c1c6a5dbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5db6 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.858948:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3ada3000/0xd270a10c1c6a5dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5db6 expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.858957:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3ada3000/0xd270a10c1c6a5dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5db6 expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.858986:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3000, rc 0) 00000100:00100000:3.0:1788833024.859034:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:15840:x1875726994341632:12345-0@lo:101:mount.lustre.0 Request processed in 150us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833024.859040:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788833024.859268:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788833024.859282:0:15840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d05f04200/0xd270a10c1c6a5db6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5dbd expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.859292:0:15840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d05f04200/0xd270a10c1c6a5db6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5dbd expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788833024.860233:0:15840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788833024.863141:0:15840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788833024.863770:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788833024.863823:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788833024.863862:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788833024.863911:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788833024.864337:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788833024.864530:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788833024.864568:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788833024.864676:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788833024.864731:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788833024.864838:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788833024.864887:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788833024.865049:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788833024.865088:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788833024.865124:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788833024.865173:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788833024.865209:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788833024.865245:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788833024.865298:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788833024.865497:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788833024.865539:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788833024.865591:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788833024.865705:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788833024.865737:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788833024.865866:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788833024.865905:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788833024.865942:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788833024.866006:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788833024.866042:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788833024.866078:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788833024.866128:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788833024.866164:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788833024.866194:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788833024.866227:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788833024.866278:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788833024.866333:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788833024.867928:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788833024.868029:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788833024.868124:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788833024.868132:0:15840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788833024.869280:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833024.869597:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833024.869650:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833024.869693:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994341760 00000100:00100000:1.0:1788833024.869701:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994341760 00000100:00100000:1.0:1788833024.869770:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788833024.869780:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:15840:x1875726994341760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788833024.870043:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:15840:x1875726994341760:12345-0@lo:501:mount.lustre.0 Request processed in 264us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833024.870051:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788833024.870170:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788833024.870205:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341888:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788833024.870243:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833024.870266:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788833024.870317:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994341888 00000100:00100000:1.0:1788833024.870322:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994341888 00000100:00100000:1.0:1788833024.870361:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788833024.870369:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:15840:x1875726994341888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788833024.871171:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:15840:x1875726994341888:12345-0@lo:503:mount.lustre.0 Request processed in 799us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833024.871179:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788833024.871292:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994341888:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788833024.873118:0:15840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788833024.873193:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994342016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833024.873256:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833024.873293:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994342016 00000100:00100000:0.0:1788833024.873299:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994342016 00000100:00100000:0.0:1788833024.873333:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788833024.873341:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:15840:x1875726994342016:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833024.873549:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:15840:x1875726994342016:12345-0@lo:502:mount.lustre.0 Request processed in 208us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833024.873557:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788833024.877936:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833024.877991:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994342016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788833024.878293:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788833024.878355:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788833024.878404:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788833024.878448:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788833024.878483:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788833024.878540:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788833024.878582:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788833024.878619:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788833024.878677:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788833024.878728:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788833024.878802:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788833024.878850:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788833024.878882:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788833024.878912:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788833024.878961:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788833024.879007:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788833024.879036:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788833024.879076:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788833024.879105:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788833024.879134:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788833024.879175:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788833024.879205:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788833024.879234:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788833024.879274:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788833024.879304:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788833024.879347:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788833024.879389:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788833024.879419:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788833024.879448:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788833024.879492:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788833024.879523:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788833024.880507:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788833024.880566:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788833024.880704:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788833024.881071:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788833024.881131:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788833024.881170:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788833024.881202:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788833024.881252:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788833024.881286:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788833024.881332:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994342144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833024.882547:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833024.883229:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994342144 00000100:00100000:3.0:1788833024.883239:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994342144 00000100:00100000:3.0:1788833024.883295:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788833024.883305:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:15840:x1875726994342144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788833024.884281:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833024.886028:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:15840:x1875726994342144:12345-0@lo:502:mount.lustre.0 Request processed in 2718us (3478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833024.886041:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788833024.886284:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994342144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788833024.886399:0:15840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788833024.886427:0:15840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788833024.889643:0:15850:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788833024.889660:0:15850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff984d064319b8) 00000020:00000080:0.0:1788833024.889683:0:15850:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788833024.890402:0:15850:0:(tgt_mount.c:153:server_get_mount()) get mount ffff984d2daa3000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788833024.890408:0:15850:0:(tgt_mount.c:187:server_put_mount()) put mount ffff984d2daa3000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788833024.890609:0:15850:0:(obd_mount.c:710:lustre_put_lsi()) put ffff984d2daa3000 3 00010000:00080000:0.0:1788833024.890649:0:15850:0:(ldlm_lib.c:102:import_set_conn()) imp ffff984d08b2d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.141@tcp at head 00010000:00010000:0.0:1788833024.896081:0:15850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788833024.897417:0:15850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788833024.897470:0:15850:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788833024.897483:0:15850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd270a10c1c6a5dcb 00000100:00080000:0.0:1788833024.897495:0:15850:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788833024.897501:0:15850:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff984d08b2d000 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:0.0:1788833024.897536:0:15850:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984c04ba7b80 x1875726994342272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788833024.897569:0:15850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788833024.897727:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875726994342272:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788833024.897828:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788833024.898107:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788833024.898112:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788833024.898176:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833024.898187:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994342400:0@lo:400:kworker.0 00000100:00100000:1.0:1788833024.898224:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833024.898252:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994342528:0@lo:400:kworker.0 00000100:00100000:1.0:1788833024.898277:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833024.898295:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788833024.898301:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994342656:0@lo:400:kworker.0 00000100:00100000:1.0:1788833024.898322:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833024.898359:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994342400 00000100:00100000:1.0:1788833024.898365:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994342400 00000100:00100000:1.0:1788833024.898406:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788833024.898415:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1875726994342400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833024.898464:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1875726994342400:12345-0@lo:400:kworker.0 Request processed in 49us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833024.898477:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788833024.898503:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994342272 00000100:00100000:1.0:1788833024.898507:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994342272 00000100:00100000:1.0:1788833024.898523:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994342528 00000100:00100000:1.0:1788833024.898525:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994342528 00000100:00100000:1.0:1788833024.898538:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994342656 00000100:00100000:1.0:1788833024.898540:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994342656 00000100:00100000:1.0:1788833024.898551:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788833024.898557:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994342528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833024.898960:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788833024.898984:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994342656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833024.902580:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994342656:12345-0@lo:400:kworker.0 Request processed in 3603us (4248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833024.902593:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788833024.902630:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788833024.902637:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875726994342272:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788833024.902685:0:14437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00010000:00080000:3.0:1788833024.902707:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3b37fb80 x1875726994342656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:0.0:1788833024.902723:0:14437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd270a10c1c6a5dd2 00000100:00100000:3.0:1788833024.902724:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994342656:0@lo:400:kworker.0 00000004:00100000:0.0:1788833024.902772:0:14437:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788833024.902803:0:14437:0:(import.c:65:import_set_state_nolock()) ffff984d3b5c4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833024.902878:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875726994342528:12345-0@lo:400:kworker.0 Request processed in 4318us (4598us total) trans 0 rc 0/0 00010000:00080000:3.0:1788833024.902879:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984d3b37ed80 x1875726994342528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788833024.902886:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788833024.902889:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875726994342528:0@lo:400:kworker.0 00000100:00100000:1.0:1788833024.904404:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994342400:0@lo:400:kworker.0 00000100:00100000:0.0:1788833024.904605:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875726994342272:12345-0@lo:38:llog_process_th.0 Request processed in 1964us (6774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833024.904614:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788833024.904696:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff984c04ba7b80 x1875726994342272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788833034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833024.904707:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788833024.904714:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788833024.904732:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788833024.904736:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788833024.904740:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d08b2d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788833024.904767:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875726994342272:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788833024.904855:0:15850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788833024.904936:0:15840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788833024.904967:0:15840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788833024.904996:0:15840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d05f04200/0xd270a10c1c6a5db6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5dbd expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833024.905007:0:15840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d05f04200/0xd270a10c1c6a5db6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5dbd expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788833024.905050:0:15840:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788833024.905053:0:15840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788833024.905054:0:15840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788833024.905055:0:15840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788833024.905056:0:15840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788833024.905057:0:15840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788833024.905059:0:15840:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788833024.905060:0:15840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788833024.905061:0:15840:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788833024.905064:0:15840:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788833024.905067:0:15840:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788833024.905068:0:15840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788833024.905069:0:15840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788833024.905070:0:15840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788833024.905071:0:15840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788833024.905072:0:15840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788833024.905073:0:15840:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788833024.905074:0:15840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788833024.905075:0:15840:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788833024.905094:0:15840:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788833024.905110:0:15840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994342784:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788833024.905164:0:15840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833024.905207:0:15840:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10c97300 going to sleep for 11 seconds 00000100:00100000:0.0:1788833024.905265:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994342784 00000100:00100000:0.0:1788833024.905273:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994342784 00000100:00100000:0.0:1788833024.905313:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788833024.905324:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3db79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:15840:x1875726994342784:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788833024.905347:0:14430:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788833024.905371:0:14430:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788833024.954439:0:14430:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788833024.954460:0:14430:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788833024.955377:0:14453:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788833024.955384:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788833024.955405:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.955423:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d3b7d8400/0xd270a10c1c6a5cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5ca5 expref: 19 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.955432:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.955468:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d3b7d8400/0xd270a10c1c6a5cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a5ca5 expref: 19 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.955482:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d3b7d8400/0xd270a10c1c6a5cac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a5ca5 expref: 19 pid: 14432 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833024.955516:0:14453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1875726994342912:0@lo:104: 00000100:00100000:1.0:1788833024.955576:0:14453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833024.956292:0:14453:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10ffcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788833024.956299:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994342912 00000100:00100000:2.0:1788833024.956307:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994342912 00000100:00100000:2.0:1788833024.956356:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788833024.956365:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:14453:x1875726994342912:12345-0@lo:104: 00010000:00010000:2.0:1788833024.956377:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5cac expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.956503:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788833024.956509:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:14453:x1875726994342912:12345-0@lo:104: Request processed in 146us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833024.956515:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788833024.956535:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833024.956540:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5cac expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.956546:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2800 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788833024.956550:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a5cac expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.956557:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a5cac expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833024.956577:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a5cac expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833024.956582:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788833024.956680:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5cac expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.956687:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788833024.956690:0:14453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1875726994342912:0@lo:104: 00010000:00010000:2.0:1788833024.956705:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5cac expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.956708:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.956711:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d3ada2800/0xd270a10c1c6a5ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5cac expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833024.956725:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833024.956727:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3314:1875726994343040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833024.956728:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833024.956729:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833024.956774:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833024.957690:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994343040 00000100:00100000:1.0:1788833024.957697:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994343040 00010000:00010000:1.0:1788833024.957722:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d3b7d8400/0xd270a10c1c6a5cac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5ca5 expref: 20 pid: 14432 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833024.957763:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788833024.957771:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+20:3314:x1875726994343040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788833024.957782:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833024.957788:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d3b7d8400/0xd270a10c1c6a5cac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5ca5 expref: 20 pid: 14432 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.957798:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d3b7d8400/0xd270a10c1c6a5cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a5ca5 expref: 20 pid: 14432 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.958062:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b7d8400/0xd270a10c1c6a5cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a5ca5 expref: 20 pid: 14432 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.958078:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.958097:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788833024.958642:0:14424:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007966853s 00010000:00010000:1.0:1788833024.958651:0:14424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.958660:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.958666:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.958671:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.958677:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833024.958681:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.958688:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.958703:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.958712:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833024.958789:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:3314:x1875726994343040:12345-0@lo:103:ldlm_bl.0 Request processed in 1019us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833024.958798:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788833024.958995:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3314:1875726994343040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788833024.959022:0:14453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.959031:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833024.959037:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d05f05800/0xd270a10c1c6a5dd9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833024.968062:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3db79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:15840:x1875726994342784:12345-0@lo:253:mount.lustre.0 Request processed in 62732us (62889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833024.968075:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788833024.968260:0:15840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:15840:1875726994342784:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788833024.968275:0:15840:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788833024.968278:0:15840:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788833024.968280:0:15840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788833024.968281:0:15840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788833024.968283:0:15840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788833024.968284:0:15840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788833024.968285:0:15840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788833024.968286:0:15840:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788833024.968288:0:15840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788833024.968289:0:15840:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788833024.968303:0:15840:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788833024.976294:0:15840:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788833024.976470:0:15840:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788833024.976633:0:15840:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788833024.976831:0:15840:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788833024.977000:0:15840:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788833024.977208:0:15840:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788833024.980565:0:15840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788833025.034656:0:15840:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788833025.034665:0:15840:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788833025.034711:0:15840:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788833025.034799:0:15840:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.141@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788833025.034813:0:15840:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788833025.034840:0:15840:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788833025.303777:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833025.942703:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788833009/real 1788833009] req@ffff984d3b37c380 x1875726994334976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833024 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833025.942729:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff984d3b37c380 x1875726994334976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788833024 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788833025.942771:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d031b1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788833025.942788:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788833025.942792:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994334976:0@lo:8:kworker.0 00000100:00100000:1.0:1788833025.942913:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3315:1875726994343168:0@lo:400:kworker.0 00000100:00100000:1.0:1788833025.942987:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788833025.943023:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788833025.943027:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788833025.943040:0:8:0:(import.c:65:import_set_state_nolock()) ffff984d031b1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788833025.943045:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 512 00000100:00100000:1.0:1788833025.943047:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1788833025.943049:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1788833025.943053:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994343296:0@lo:400:kworker.0 00000100:00080000:2.0:1788833025.943055:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff984d031b1000 using connection 192.168.206.141@tcp/0@lo 00000100:00100000:2.0:1788833025.943073:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff984d3ace7b80 x1875726994343424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788833025.943078:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833025.943099:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994343552:0@lo:400:kworker.0 00000100:00100000:2.0:1788833025.943119:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994343424:0@lo:8:kworker.0 00000100:00100000:1.0:1788833025.943119:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833025.943146:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994343296 00000100:00100000:1.0:1788833025.943153:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994343296 00000100:00100000:1.0:1788833025.943200:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788833025.943209:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1875726994343296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833025.943245:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833025.943260:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1875726994343296:12345-0@lo:400:kworker.0 Request processed in 53us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833025.943268:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788833025.943280:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994343424 00000100:00100000:1.0:1788833025.943284:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994343424 00000100:00080000:2.0:1788833025.943288:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788833025.943299:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994343552 00000100:00100000:1.0:1788833025.943299:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788833025.943301:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994343552 00000100:00100000:1.0:1788833025.943303:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1875726994343424:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788833025.943323:0:15121:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000100:00100000:2.0:1788833025.943324:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788833025.943330:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994343552:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1788833025.943350:0:15121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd270a10c1c6a5de0 00000100:00100000:2.0:1788833025.943357:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994343552:12345-0@lo:400:kworker.0 Request processed in 28us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833025.943362:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00002000:00100000:1.0:1788833025.943363:0:15121:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff984d3de77800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788833025.943367:0:15121:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788833025.943369:0:15121:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788833025.943685:0:15121:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788833025.943704:0:15121:0:(import.c:65:import_set_state_nolock()) ffff984d3de71000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833025.943766:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875726994343424:12345-0@lo:8:kworker.0 Request processed in 461us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833025.943773:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788833025.943779:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3ace7b80 x1875726994343424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788833045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833025.943789:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1788833025.943793:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994343680:0@lo:400:kworker.0 00000100:00080000:2.0:1788833025.943794:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788833025.943800:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788833025.943804:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788833025.943807:0:3313:0:(import.c:65:import_set_state_nolock()) ffff984d031b1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788833025.943816:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833025.943834:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788833025.943840:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994343808:0@lo:400:kworker.0 00000100:00100000:1.0:1788833025.943863:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833025.943886:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994343680 00000100:00100000:1.0:1788833025.943889:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994343680 00000100:00100000:1.0:1788833025.943914:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994343808 00000100:00100000:1.0:1788833025.943916:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994343808 00000004:00080000:2.0:1788833025.943923:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788833025.943929:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875726994343424:0@lo:8:kworker.0 00000100:00100000:1.0:1788833025.943932:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788833025.943944:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994343680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833025.943963:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788833025.943988:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994343808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788833025.943990:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994343680:12345-0@lo:400:kworker.0 Request processed in 47us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833025.943995:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788833025.944016:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994343808:12345-0@lo:400:kworker.0 Request processed in 30us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833025.944022:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1788833025.944031:0:14462:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00080000:2.0:1788833025.944038:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833025.944045:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1875726994344064:0@lo:5:osp-pre-1-0.0 00010000:00080000:2.0:1788833025.944052:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3ace7800 x1875726994343552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833025.944061:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994343552:0@lo:400:kworker.0 00000100:00100000:1.0:1788833025.944069:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833025.944071:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994343296:0@lo:400:kworker.0 00000100:00100000:1.0:1788833025.944083:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d063489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833025.944084:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788833025.944089:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994343936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788833025.944095:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994344064 00000100:00100000:1.0:1788833025.944098:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994344064 00000100:00100000:2.0:1788833025.944110:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833025.944122:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788833025.944128:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14462:x1875726994344064:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788833025.944131:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994343936 00000100:00100000:2.0:1788833025.944134:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994343936 00000004:00080000:0.0:1788833025.944237:0:14461:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788833025.944537:0:14461:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 529634792754ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788833025.944795:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788833025.944802:0:15125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875726994343936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788833025.944878:0:15125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833025.944920:0:15125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875726994343936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833025.944926:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788833025.944964:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d39f2dc00 x1875726994343936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788833041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833025.944991:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994343936:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788833025.945034:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788833025.945057:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3ace6680 x1875726994343808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833025.945073:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994343808:0@lo:400:kworker.0 00010000:00080000:2.0:1788833025.945086:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984d3ace6a00 x1875726994343680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788833025.945094:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994343680:0@lo:400:kworker.0 00000100:00100000:3.0:1788833025.946174:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994343168 00000100:00100000:3.0:1788833025.946182:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994343168 00000100:00100000:3.0:1788833025.946220:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788833025.946227:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:3315:x1875726994343168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833025.946282:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:3315:x1875726994343168:12345-0@lo:400:kworker.0 Request processed in 55us (3295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833025.946289:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788833025.948134:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3315:1875726994343168:0@lo:400:kworker.0 00002000:00080000:1.0:1788833025.950953:0:15123:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788833025.950961:0:15123:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788833025.950982:0:15123:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1788833025.974704:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833025.974717:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a5de7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.974735:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788833025.974740:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833025.974787:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a5de7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.974808:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a5de7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.974832:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a5de7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.974840:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a5de7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.974860:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788833025.975403:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833025.975411:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0d8e751/0xd270a10c1c6a5dee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.975421:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788833025.975425:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833025.975429:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0d8e751/0xd270a10c1c6a5dee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.975439:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0d8e751/0xd270a10c1c6a5dee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.975459:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0d8e751/0xd270a10c1c6a5dee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.975467:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0d8e751/0xd270a10c1c6a5dee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.975496:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788833025.975500:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788833025.975507:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833025.975510:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a5de7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.975522:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05a00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788833025.975527:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a5de7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.975537:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a5de7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.975555:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a5de7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.975563:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000201ace81/0xd270a10c1c6a5de7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.975581:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833025.975583:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833025.975590:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833025.976083:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833025.976089:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5df5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.976098:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788833025.976101:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833025.976106:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5df5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.976114:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5df5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.976123:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5df5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.976129:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5df5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.976148:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833025.976219:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833025.976225:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5df5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.976233:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04a00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788833025.976237:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5df5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.976247:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5df5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.976261:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5df5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.976268:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c86699f/0xd270a10c1c6a5df5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.976285:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833025.976287:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833025.976289:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788833025.976527:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833025.976532:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca515ae/0xd270a10c1c6a5dfc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.976541:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788833025.976549:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833025.976554:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ca515ae/0xd270a10c1c6a5dfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.976564:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ca515ae/0xd270a10c1c6a5dfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.976572:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca515ae/0xd270a10c1c6a5dfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.976578:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ca515ae/0xd270a10c1c6a5dfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.976596:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788833025.977037:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788833025.977044:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e075e23b/0xd270a10c1c6a5e03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.977052:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788833025.977055:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788833025.977058:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e075e23b/0xd270a10c1c6a5e03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.977067:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e075e23b/0xd270a10c1c6a5e03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.977074:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e075e23b/0xd270a10c1c6a5e03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.977085:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e075e23b/0xd270a10c1c6a5e03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.977092:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788833025.979566:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788833025.979577:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ca515ae/0xd270a10c1c6a5dfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.979589:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05400 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788833025.979593:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca515ae/0xd270a10c1c6a5dfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.979617:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca515ae/0xd270a10c1c6a5dfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.979637:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ca515ae/0xd270a10c1c6a5dfc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.979644:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ca515ae/0xd270a10c1c6a5dfc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.979662:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833025.979666:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e075e23b/0xd270a10c1c6a5e03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.979672:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788833025.979674:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e075e23b/0xd270a10c1c6a5e03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.979681:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e075e23b/0xd270a10c1c6a5e03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.979691:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e075e23b/0xd270a10c1c6a5e03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.979696:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e075e23b/0xd270a10c1c6a5e03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833025.979719:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833025.979721:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833025.979723:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.981504:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.981517:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0d8e751/0xd270a10c1c6a5dee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.981530:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05200 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833025.981535:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0d8e751/0xd270a10c1c6a5dee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.981558:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0d8e751/0xd270a10c1c6a5dee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.981578:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0d8e751/0xd270a10c1c6a5dee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.981585:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0d8e751/0xd270a10c1c6a5dee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.981603:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.981605:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.981607:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.981612:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.981613:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833025.982214:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833025.982225:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.982247:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833025.982251:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833025.982258:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.982271:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.982281:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.982288:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.982308:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833025.983052:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833025.983072:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.983082:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bae00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833025.983087:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.983095:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.983111:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.983127:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.983157:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.983159:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.983161:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833025.985366:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833025.985377:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.985391:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833025.985395:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833025.985401:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.985414:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.986216:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.986230:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.986257:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833025.986492:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833025.986501:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.986510:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bac00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833025.986515:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.986523:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.986541:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.986547:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.986564:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.986566:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.986568:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833025.987198:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833025.987207:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.987218:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833025.987222:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833025.987228:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.987239:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.987248:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.987254:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.987298:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788833025.987773:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833025.987780:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.987788:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833025.987791:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833025.987796:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.987805:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.987813:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.987820:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.987833:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788833025.988014:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788833025.988022:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.988032:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bbe00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833025.988036:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.988046:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.988062:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e18 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.988070:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.988086:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833025.988090:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.988096:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833025.988100:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.988108:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.988134:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.988154:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.988168:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.988170:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.988172:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.988180:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833025.988982:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833025.988999:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.989009:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833025.989019:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833025.989024:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.989034:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.989043:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.989050:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.989070:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833025.989739:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833025.989762:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.989771:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833025.989774:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.989784:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.989799:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.989807:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.989836:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.989838:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.989840:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833025.990407:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833025.990415:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.990425:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833025.990429:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833025.990434:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.990892:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.990902:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.990917:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.990931:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788833025.991846:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833025.991855:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.991867:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833025.991871:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833025.991876:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.991886:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.991893:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.991900:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.991913:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788833025.992358:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788833025.992358:0:15903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833025.992372:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.992372:0:15903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.992398:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036baa00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833025.992399:0:15903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba400 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833025.992407:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.992407:0:15903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.992435:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.992435:0:15903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.992456:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.992463:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.992480:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.992482:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.992484:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788833025.994506:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788833025.994774:0:15903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.994784:0:15903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.994807:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833025.994810:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833025.994812:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833025.995700:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833025.995710:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.995732:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833025.995736:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833025.995835:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.995850:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.995859:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.995867:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.995892:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833025.996002:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833025.996010:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.996025:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba000 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833025.996030:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.996039:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.996055:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.996063:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.996084:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.996087:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.996088:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833025.996701:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833025.996709:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.996719:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833025.996723:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833025.996729:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.996738:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.996831:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.996838:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.996854:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833025.997272:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833025.997280:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.997289:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833025.997293:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.997301:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.997322:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.997329:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833025.997347:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.997349:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833025.997351:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833025.997509:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833025.997515:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fb952ea/0xd270a10c1c6a5e49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.997524:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833025.997528:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833025.997533:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fb952ea/0xd270a10c1c6a5e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.997542:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fb952ea/0xd270a10c1c6a5e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.997551:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fb952ea/0xd270a10c1c6a5e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.997558:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fb952ea/0xd270a10c1c6a5e49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.997759:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788833025.998180:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833025.998187:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ccc21d/0xd270a10c1c6a5e50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.998196:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833025.998200:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833025.998204:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016ccc21d/0xd270a10c1c6a5e50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.998215:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016ccc21d/0xd270a10c1c6a5e50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.998222:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ccc21d/0xd270a10c1c6a5e50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.998230:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016ccc21d/0xd270a10c1c6a5e50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.998513:0:15903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788833025.998527:0:15903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fb952ea/0xd270a10c1c6a5e49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.998535:0:15903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb000 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833025.998539:0:15903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fb952ea/0xd270a10c1c6a5e49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.998548:0:15903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fb952ea/0xd270a10c1c6a5e49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.998682:0:15903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fb952ea/0xd270a10c1c6a5e49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.998692:0:15903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fb952ea/0xd270a10c1c6a5e49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.998710:0:15903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833025.998713:0:15903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016ccc21d/0xd270a10c1c6a5e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.998721:0:15903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bbc00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833025.998724:0:15903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016ccc21d/0xd270a10c1c6a5e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.998733:0:15903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016ccc21d/0xd270a10c1c6a5e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.998777:0:15903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016ccc21d/0xd270a10c1c6a5e50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833025.998785:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833025.998787:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833025.998789:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833025.998867:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788833025.998874:0:15123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016ccc21d/0xd270a10c1c6a5e50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788833025.999396:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833025.999403:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b846a3e/0xd270a10c1c6a5e57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.999419:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833025.999423:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833025.999427:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b846a3e/0xd270a10c1c6a5e57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833025.999437:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b846a3e/0xd270a10c1c6a5e57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.001430:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b846a3e/0xd270a10c1c6a5e57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.001452:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b846a3e/0xd270a10c1c6a5e57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.001690:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833026.001698:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b846a3e/0xd270a10c1c6a5e57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.001707:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833026.001712:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b846a3e/0xd270a10c1c6a5e57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.001721:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b846a3e/0xd270a10c1c6a5e57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.001741:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b846a3e/0xd270a10c1c6a5e57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.001766:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.001767:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.001770:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833026.002233:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788833026.002240:0:15123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b846a3e/0xd270a10c1c6a5e57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.002802:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833026.003786:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833026.003795:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.003810:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833026.003814:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833026.003820:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.003845:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.003855:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.003862:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.003888:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833026.003976:0:15903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833026.003984:0:15903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.004000:0:15903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036baa00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833026.004005:0:15903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.004013:0:15903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.004029:0:15903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.004036:0:15903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dea89f93/0xd270a10c1c6a5e5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.004051:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.004053:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.004055:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833026.004686:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833026.004693:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.004703:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833026.004707:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833026.004711:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.004721:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.004731:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.004769:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.004784:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833026.004838:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833026.004845:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.004853:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba600 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833026.004857:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.004866:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.004898:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.004907:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000762e14ca/0xd270a10c1c6a5e65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.004924:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.004926:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.004928:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833026.005697:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833026.005704:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.005714:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833026.005718:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833026.005722:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.005733:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.005762:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.005770:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.005786:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833026.006092:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833026.006098:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.006106:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833026.006110:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.006117:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.006129:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.006135:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d058cc/0xd270a10c1c6a5e6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.006175:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.006177:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.006179:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833026.006285:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833026.006291:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.006304:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833026.006307:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833026.006312:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.006322:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.006329:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.006335:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.006356:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833026.006374:0:15903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833026.006380:0:15903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.006388:0:15903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bbe00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833026.006391:0:15903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.006399:0:15903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.006409:0:15903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.006416:0:15903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fbaa324/0xd270a10c1c6a5e73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.006432:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.006435:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.006439:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833026.009110:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833026.009122:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.009137:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833026.009141:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833026.009147:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.009161:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.009182:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.009190:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.009214:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788833026.009310:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788833026.009318:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833026.009328:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bac00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833026.009332:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833026.009342:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833026.009361:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833026.009369:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054775fef/0xd270a10c1c6a5e7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833026.009400:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833026.009403:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788833026.009406:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833026.010426:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833026.010436:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.010462:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833026.010466:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833026.010472:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.010483:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.010493:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.010502:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.010534:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833026.010599:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833026.010607:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.010625:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bae00 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833026.010629:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.010637:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.010664:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.010671:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e97843c/0xd270a10c1c6a5e81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.010690:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.010692:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.010694:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833026.011154:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833026.011161:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.011171:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833026.011174:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833026.011178:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.011188:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.011196:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.011204:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.011226:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833026.011310:0:15903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833026.011316:0:15903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.011325:0:15903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba400 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833026.011329:0:15903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.011336:0:15903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.011355:0:15903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.011361:0:15903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088593864/0xd270a10c1c6a5e88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.011377:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.011379:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.011381:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833026.012270:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833026.012278:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.012288:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833026.012348:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833026.012353:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.012364:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.012373:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.012380:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.012404:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833026.012584:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833026.012590:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.012599:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833026.012602:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.012611:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.012624:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.012631:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063e23d50/0xd270a10c1c6a5e8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.012669:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.012670:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.012672:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833026.013180:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833026.013186:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.013195:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833026.013199:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833026.013203:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.013212:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.013220:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.013232:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.013255:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833026.013309:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833026.013315:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.013323:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba000 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833026.013327:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.013334:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.013345:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.013352:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a5e96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.013366:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.013368:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.013369:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788833026.013938:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788833026.013945:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a5e9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.013954:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788833026.013958:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833026.013963:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a5e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.016029:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a5e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.016043:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a5e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.016051:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a5e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.016076:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788833026.016248:0:15903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833026.016256:0:15903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a5e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.016281:0:15903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d4207e000 already unused, calling callback (ffffffffc1438370) 00010000:00010000:1.0:1788833026.016285:0:15903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a5e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.016296:0:15903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a5e9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.016315:0:15903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a5e9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.016323:0:15903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe88ec68/0xd270a10c1c6a5e9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.016346:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.016348:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833026.016350:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788833026.016385:0:15123:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1788833026.016636:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14462:x1875726994344064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 72504us (72560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833026.016651:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788833026.016791:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1875726994344064:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788833026.016806:0:14462:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788833026.016851:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1875726994344192:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788833026.017026:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833026.017077:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d063489c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788833026.017117:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994344192 00000100:00100000:3.0:1788833026.017124:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994344192 00000100:00100000:3.0:1788833026.017171:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788833026.017179:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14462:x1875726994344192:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788833026.017212:0:15124:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1788833026.032298:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1875726994344192:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788833026.032316:0:14462:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788833026.032520:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14462:x1875726994344192:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15062us (15355us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788833026.032531:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 10000000:01000000:2.0:1788833026.069834:0:14434:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788833026.069841:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff984d1198f000 from 8 10000000:01000000:2.0:1788833026.069846:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788833026.069901:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702c00/0xd270a10c1c6a5ea4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833026.069912:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3b702c00/0xd270a10c1c6a5ea4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833026.069923:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3b702c00/0xd270a10c1c6a5ea4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833026.069949:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994344320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788833026.070023:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833026.070080:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3b1d60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833026.070306:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994344320 00000100:00100000:0.0:1788833026.070314:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994344320 00000100:00100000:0.0:1788833026.070368:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788833026.070377:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:14434:x1875726994344320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833026.070390:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833026.070405:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d4207fc00/0xd270a10c1c6a5eab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5ea4 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.070427:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d4207fc00/0xd270a10c1c6a5eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5ea4 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.070436:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d4207fc00/0xd270a10c1c6a5eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5ea4 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.070444:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d4207fc00, rc 0) 00000100:00100000:0.0:1788833026.070488:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:14434:x1875726994344320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833026.070495:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788833026.070549:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994344320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833026.070563:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3b702c00/0xd270a10c1c6a5ea4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5eab expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.070571:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3b702c00/0xd270a10c1c6a5ea4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5eab expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833026.070625:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994344448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788833026.070680:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833026.070698:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d8a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788833026.070711:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994344448 00000100:00100000:0.0:1788833026.070715:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994344448 00000100:00100000:0.0:1788833026.070738:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788833026.070766:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:14434:x1875726994344448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788833026.070779:0:14432:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788833026.070796:0:14432:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788833026.070799:0:14432:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788833026.070875:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:14434:x1875726994344448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833026.070882:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788833026.071060:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994344448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788833026.071114:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788833026.071122:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702c00/0xd270a10c1c6a5ea4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5eab expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833026.071131:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3b702c00/0xd270a10c1c6a5ea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5eab expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833026.330923:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833027.350358:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788833028.356857:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788833028.356988:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1788833028.373940:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833029.271136:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994344576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788833029.271205:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833029.271399:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994344576 00000100:00100000:3.0:1788833029.271407:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994344576 00000100:00100000:3.0:1788833029.271474:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788833029.271484:0:15125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994344576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788833029.271517:0:15125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833029.271584:0:15125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994344576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833029.271591:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788833029.271699:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788833029.271821:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788833029.271844:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994344576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788833029.398037:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833030.427205:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788833030.453787:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788833030.453803:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:3.0:1788833031.323154:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994344704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788833031.323285:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833031.323582:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994344704 00000100:00100000:3.0:1788833031.323590:0:15126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994344704 00000100:00100000:3.0:1788833031.323639:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788833031.323649:0:15126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994344704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788833031.323700:0:15126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833031.324016:0:15126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994344704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 368us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833031.324024:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788833031.324046:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788833031.327060:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994344960:0@lo:400:kworker.0 00000100:00100000:0.0:1788833031.327142:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833031.330064:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994345216:0@lo:400:kworker.0 00000100:00100000:3.0:1788833031.330146:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833031.330201:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788833031.330226:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994344704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788833031.330245:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788833031.330252:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3314:1875726994344832:0@lo:400:kworker.0 00000100:00100000:3.0:1788833031.330286:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833031.330326:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994345344:0@lo:400:kworker.0 00000100:00100000:3.0:1788833031.330354:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833031.330385:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994345216 00000100:00100000:3.0:1788833031.330392:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994345216 00000100:00100000:3.0:1788833031.330436:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994345344 00000100:00100000:3.0:1788833031.330440:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994345344 00000100:00100000:3.0:1788833031.330469:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788833031.330478:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994345216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833031.330544:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875726994345216:12345-0@lo:400:kworker.0 Request processed in 67us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833031.330551:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788833031.330579:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788833031.330587:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994345344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833031.331022:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994345344:12345-0@lo:400:kworker.0 Request processed in 436us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833031.331030:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788833031.331050:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788833031.331083:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984c04ba7480 x1875726994345344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833031.331095:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994345344:0@lo:400:kworker.0 00010000:00080000:3.0:1788833031.331105:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984c04ba4380 x1875726994345216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788833031.331177:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875726994345216:0@lo:400:kworker.0 00000100:00100000:0.0:1788833031.331627:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994344832 00000100:00100000:0.0:1788833031.331640:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994344832 00000100:00100000:0.0:1788833031.331681:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788833031.331689:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:3314:x1875726994344832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833031.331771:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:3314:x1875726994344832:12345-0@lo:400:kworker.0 Request processed in 53us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833031.331779:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788833031.331818:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994345088:0@lo:400:kworker.0 00000100:00100000:0.0:1788833031.331849:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833031.331888:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994344960 00000100:00100000:0.0:1788833031.331892:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994344960 00000100:00100000:0.0:1788833031.331928:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788833031.331934:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994344960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833031.331977:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994344960:12345-0@lo:400:kworker.0 Request processed in 44us (4835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833031.331983:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788833031.332015:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994345088 00000100:00100000:0.0:1788833031.332018:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994345088 00000100:00100000:0.0:1788833031.332041:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788833031.332047:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994345088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833031.332077:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994345088:12345-0@lo:400:kworker.0 Request processed in 30us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833031.332082:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788833031.332095:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788833031.332114:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff984c04ba5880 x1875726994345088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788833047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788833031.332124:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994345088:0@lo:400:kworker.0 00000100:00100000:0.0:1788833031.332152:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994344960:0@lo:400:kworker.0 00000100:00100000:2.0:1788833031.332952:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3314:1875726994344832:0@lo:400:kworker.0 00010000:00010000:0.0:1788833031.447895:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788833031.604038:0:16197:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg641-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1788833031.897383:0:14470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788833032.471289:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788833033.493954:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833033.878864:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833033.879179:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975476224 00000100:00100000:0.0:1788833033.879202:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975476224 00000100:00100000:0.0:1788833033.879262:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 76 00000100:00100000:0.0:1788833033.879273:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2356:x1875726975476224:12345-192.168.206.41@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788833033.879320:0:14431:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 40885574-0d1f-4d1b-98c1-89cfcedce8f0@192.168.206.41@tcp t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:0.0:1788833033.879370:0:14431:0:(genops.c:1385:class_connect()) connect: client 40885574-0d1f-4d1b-98c1-89cfcedce8f0, cookie 0xd270a10c1c6a5eb2 00000100:00080000:0.0:1788833033.879553:0:14431:0:(import.c:65:import_set_state_nolock()) ffff984d3b5c7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788833033.879639:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+5:2356:x1875726975476224:12345-192.168.206.41@tcp:250:mount.lustre.0 Request processed in 367us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833033.879647:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 76 00000100:00100000:1.0:1788833033.890318:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833033.890475:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975476352 00000100:00100000:0.0:1788833033.890493:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975476352 00000100:00100000:0.0:1788833033.890571:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 77 00000100:00100000:0.0:1788833033.890584:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+5:13797:x1875726975476352:12345-192.168.206.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788833033.890607:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833033.890634:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d4207e000/0xd270a10c1c6a5eb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b557bd expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833033.890673:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d4207e000/0xd270a10c1c6a5eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557bd expref: 6 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833033.890687:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d4207e000/0xd270a10c1c6a5eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557bd expref: 6 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833033.890699:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d4207e000, rc 0) 00000100:00100000:0.0:1788833033.890816:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+6:13797:x1875726975476352:12345-192.168.206.41@tcp:101:mount.lustre.0 Request processed in 233us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833033.890845:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 77 00000100:00100000:2.0:1788833033.893613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833033.895553:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975476480 00000100:00100000:0.0:1788833033.895573:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975476480 00000100:00100000:0.0:1788833033.895672:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 78 00000100:00100000:0.0:1788833033.895685:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+6:13797:x1875726975476480:12345-192.168.206.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788833033.896864:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+6:13797:x1875726975476480:12345-192.168.206.41@tcp:501:mount.lustre.0 Request processed in 1160us (3242us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788833033.896879:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 78 00000100:00100000:3.0:1788833033.905938:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833033.906352:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975476608 00000100:00100000:1.0:1788833033.906366:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975476608 00000100:00100000:1.0:1788833033.906435:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 79 00000100:00100000:1.0:1788833033.906448:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+6:13797:x1875726975476608:12345-192.168.206.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788833033.906470:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833033.906492:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d05f04e00/0xd270a10c1c6a5ec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b557c4 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833033.906529:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d05f04e00/0xd270a10c1c6a5ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557c4 expref: 7 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833033.906542:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d05f04e00/0xd270a10c1c6a5ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557c4 expref: 7 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833033.906552:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04e00, rc 0) 00000100:00100000:1.0:1788833033.906630:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+7:13797:x1875726975476608:12345-192.168.206.41@tcp:101:mount.lustre.0 Request processed in 184us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833033.906638:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 79 00000100:00100000:1.0:1788833033.911001:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833033.916510:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975476736 00000100:00100000:0.0:1788833033.916533:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975476736 00000100:00100000:0.0:1788833033.916618:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 80 00000100:00100000:0.0:1788833033.916631:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+7:13797:x1875726975476736:12345-192.168.206.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788833033.917385:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+8:13797:x1875726975476736:12345-192.168.206.41@tcp:501:mount.lustre.0 Request processed in 750us (6391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833033.917395:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 80 00000100:00100000:3.0:1788833033.921577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833033.921810:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975476864 00000100:00100000:2.0:1788833033.921823:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975476864 00000100:00100000:2.0:1788833033.921892:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 81 00000100:00100000:2.0:1788833033.921904:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+8:13797:x1875726975476864:12345-192.168.206.41@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788833033.922496:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+8:13797:x1875726975476864:12345-192.168.206.41@tcp:503:mount.lustre.0 Request processed in 591us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833033.922507:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 81 00000100:00100000:3.0:1788833033.933637:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833033.937853:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975476992 00000100:00100000:0.0:1788833033.937876:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975476992 00000100:00100000:0.0:1788833033.938112:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 82 00000100:00100000:0.0:1788833033.938127:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+8:13815:x1875726975476992:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788833033.938614:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+8:13815:x1875726975476992:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 487us (4989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833033.938624:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 82 00000100:00100000:1.0:1788833033.961151:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833033.961396:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975477120 00000100:00100000:2.0:1788833033.961409:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975477120 00000100:00100000:2.0:1788833033.961488:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 83 00000100:00100000:2.0:1788833033.961501:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+8:13815:x1875726975477120:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788833033.961900:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+8:13815:x1875726975477120:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 400us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833033.961910:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 83 00000100:00100000:2.0:1788833033.970613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833033.970882:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975477248 00000100:00100000:0.0:1788833033.970892:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975477248 00000100:00100000:0.0:1788833033.970971:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 84 00000100:00100000:0.0:1788833033.970981:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+8:13797:x1875726975477248:12345-192.168.206.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788833033.971007:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833033.971026:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d4207e600/0xd270a10c1c6a5ec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b557ee expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833033.971056:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d4207e600/0xd270a10c1c6a5ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557ee expref: 9 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833033.971069:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d4207e600/0xd270a10c1c6a5ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557ee expref: 9 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833033.971078:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d4207e600, rc 0) 00000100:00100000:0.0:1788833033.971144:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+9:13797:x1875726975477248:12345-192.168.206.41@tcp:101:mount.lustre.0 Request processed in 164us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833033.971150:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 84 00000100:00100000:0.0:1788833033.980549:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833033.983841:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975477376 00000100:00100000:3.0:1788833033.983855:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975477376 00000100:00100000:2.0:1788833033.984012:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 85 00000100:00100000:2.0:1788833033.984024:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+9:13797:x1875726975477376:12345-192.168.206.41@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788833033.984047:0:14432:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788833033.984066:0:14432:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788833033.984070:0:14432:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788833033.984073:0:14432:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788833033.984075:0:14432:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788833033.986412:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+9:13797:x1875726975477376:12345-192.168.206.41@tcp:256:mount.lustre.0 Request processed in 2381us (5863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833033.986425:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 85 00000100:00100000:0.0:1788833033.995166:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833033.995504:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975477504 00000100:00100000:2.0:1788833033.995529:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975477504 00000100:00100000:2.0:1788833033.995656:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 86 00000100:00100000:2.0:1788833033.995667:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+9:13797:x1875726975477504:12345-192.168.206.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788833033.995693:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833033.995726:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a5ece lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b557f5 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833033.995786:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a5ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557f5 expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833033.995798:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a5ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557f5 expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833033.995806:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702000, rc 0) 00000100:00100000:2.0:1788833033.995999:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+10:13797:x1875726975477504:12345-192.168.206.41@tcp:101:mount.lustre.0 Request processed in 333us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833033.996007:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 86 00000100:00100000:0.0:1788833034.005352:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833034.010164:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975477632 00000100:00100000:2.0:1788833034.010178:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975477632 00000100:00100000:2.0:1788833034.010358:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 87 00000100:00100000:2.0:1788833034.010369:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+10:13797:x1875726975477632:12345-192.168.206.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788833034.010676:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+10:13797:x1875726975477632:12345-192.168.206.41@tcp:501:mount.lustre.0 Request processed in 307us (5330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833034.010684:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 87 00000100:00100000:1.0:1788833034.015390:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833034.015475:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975477760 00000100:00100000:3.0:1788833034.015484:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975477760 00000100:00100000:3.0:1788833034.015540:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 88 00000100:00100000:3.0:1788833034.015549:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+10:13797:x1875726975477760:12345-192.168.206.41@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788833034.015972:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+10:13797:x1875726975477760:12345-192.168.206.41@tcp:503:mount.lustre.0 Request processed in 424us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833034.015980:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 88 00000100:00100000:0.0:1788833034.022427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833034.022524:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975477888 00000100:00100000:1.0:1788833034.022533:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975477888 00000100:00100000:1.0:1788833034.022587:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 89 00000100:00100000:1.0:1788833034.022597:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+10:13819:x1875726975477888:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788833034.022939:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+10:13819:x1875726975477888:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 342us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833034.022948:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 89 00000100:00100000:0.0:1788833034.030497:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833034.030579:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975478016 00000100:00100000:2.0:1788833034.030589:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975478016 00000100:00100000:2.0:1788833034.030652:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 90 00000100:00100000:2.0:1788833034.030677:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+10:13819:x1875726975478016:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788833034.030948:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+10:13819:x1875726975478016:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 287us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833034.030956:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 90 00000100:00100000:2.0:1788833034.047407:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833034.047551:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975478144 00000100:00100000:3.0:1788833034.047561:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975478144 00000100:00100000:3.0:1788833034.047621:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 4 00000100:00100000:3.0:1788833034.047629:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1875726975478144:12345-192.168.206.41@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788833034.047657:0:14438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3e168a9c-e2a0-4132-9a92-188a53d61a6f@192.168.206.41@tcp t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:3.0:1788833034.047699:0:14438:0:(genops.c:1385:class_connect()) connect: client 3e168a9c-e2a0-4132-9a92-188a53d61a6f, cookie 0xd270a10c1c6a5ed5 00000004:00100000:3.0:1788833034.047727:0:14438:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788833034.047733:0:14438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788833034.098996:0:14438:0:(import.c:65:import_set_state_nolock()) ffff984d3aa4e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788833034.099061:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:2356:x1875726975478144:12345-192.168.206.41@tcp:38:mount.lustre.0 Request processed in 51431us (51661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833034.099071:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 4 00000100:00100000:0.0:1788833034.101607:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833034.101651:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833034.101722:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975478400 00000100:00100000:3.0:1788833034.101739:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975478400 00000100:00100000:1.0:1788833034.101796:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975478272 00000100:00100000:1.0:1788833034.101808:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975478272 00000100:00080000:0.0:1788833034.101877:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833034.102019:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 5 00000100:00100000:3.0:1788833034.102036:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+7:13797:x1875726975478400:12345-192.168.206.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788833034.102097:0:14439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788833034.103110:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+7:13797:x1875726975478400:12345-192.168.206.41@tcp:41:mount.lustre.0 Request processed in 1072us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833034.103123:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 5 00000100:00100000:3.0:1788833034.103165:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:3.0:1788833034.103183:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:0:x1875726975478272:12345-192.168.206.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788833034.103215:0:14439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788833034.103252:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:0:x1875726975478272:12345-192.168.206.41@tcp:41:mount.lustre.0 Request processed in 74us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833034.103259:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:0.0:1788833034.108065:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833034.108208:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975478528 00000100:00100000:1.0:1788833034.108217:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975478528 00000100:00100000:1.0:1788833034.108265:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:1.0:1788833034.108274:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:13797:x1875726975478528:12345-192.168.206.41@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788833034.108443:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:13797:x1875726975478528:12345-192.168.206.41@tcp:40:mount.lustre.0 Request processed in 169us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833034.108450:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:3.0:1788833034.113853:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833034.113918:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833034.113968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833034.114046:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975478656 00000100:00100000:1.0:1788833034.114062:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975478656 00000100:00100000:0.0:1788833034.114063:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975478784 00000100:00100000:0.0:1788833034.114075:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975478784 00000100:00100000:1.0:1788833034.114200:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:1.0:1788833034.114208:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1875726975478656:12345-192.168.206.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788833034.114237:0:15123:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3e168a9c-e2a0-4132-9a92-188a53d61a6f@192.168.206.41@tcp t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:1.0:1788833034.114271:0:15123:0:(genops.c:1385:class_connect()) connect: client 3e168a9c-e2a0-4132-9a92-188a53d61a6f, cookie 0xd270a10c1c6a5edc 00002000:00100000:1.0:1788833034.114282:0:15123:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3e168a9c-e2a0-4132-9a92-188a53d61a6f/ffff984d3de74800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788833034.114329:0:15123:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788833034.114621:0:15123:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788833034.114650:0:15123:0:(import.c:65:import_set_state_nolock()) ffff984d3de72800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833034.114718:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:2356:x1875726975478656:12345-192.168.206.41@tcp:8:mount.lustre.0 Request processed in 508us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833034.114726:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:1.0:1788833034.114778:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:1.0:1788833034.114785:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1875726975478784:12345-192.168.206.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788833034.114801:0:15123:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3e168a9c-e2a0-4132-9a92-188a53d61a6f@192.168.206.41@tcp t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:1.0:1788833034.114821:0:15123:0:(genops.c:1385:class_connect()) connect: client 3e168a9c-e2a0-4132-9a92-188a53d61a6f, cookie 0xd270a10c1c6a5ee3 00002000:00100000:1.0:1788833034.114827:0:15123:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3e168a9c-e2a0-4132-9a92-188a53d61a6f/ffff984d3de77000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788833034.114840:0:15123:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788833034.115062:0:15123:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788833034.115077:0:15123:0:(import.c:65:import_set_state_nolock()) ffff984d3de75000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788833034.115511:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975478912 00000100:00100000:2.0:1788833034.115519:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975478912 00000100:00100000:2.0:1788833034.115565:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00100000:2.0:1788833034.115573:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:13797:x1875726975478912:12345-192.168.206.41@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788833034.116894:0:14440:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1263us 00000100:00100000:2.0:1788833034.116971:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:2356:x1875726975478784:12345-192.168.206.41@tcp:8:mount.lustre.0 Request processed in 2181us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833034.116982:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 7 00000004:00200000:2.0:1788833034.145298:0:14440:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788833034.145503:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:13797:x1875726975478912:12345-192.168.206.41@tcp:33:mount.lustre.0 Request processed in 29926us (31659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833034.145514:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00100000:0.0:1788833034.313024:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833034.313118:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975479040 00000100:00100000:2.0:1788833034.313127:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975479040 00000100:00100000:2.0:1788833034.313193:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:2.0:1788833034.313204:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:13841:x1875726975479040:12345-192.168.206.41@tcp:101:mkdir.0 00010000:00010000:2.0:1788833034.313223:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833034.313247:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5eea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5581f expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.313349:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5ef1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.313363:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.313376:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833034.313407:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788833034.313410:0:14437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833034.313442:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.313465:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a5eea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5581f expref: 8 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.313826:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5581f expref: 7 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833034.313835:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d06f05500) 00010000:00010000:2.0:1788833034.313838:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788833034.313841:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702a00, rc 0) 00000100:00100000:2.0:1788833034.313910:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+7:13841:x1875726975479040:12345-192.168.206.41@tcp:101:mkdir.0 Request processed in 707us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833034.313917:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:1.0:1788833034.390404:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788833034.394238:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994345472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833034.394349:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833034.399463:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994345472 00000100:00100000:3.0:1788833034.399484:0:15126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994345472 00000100:00100000:3.0:1788833034.399617:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788833034.399630:0:15126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994345472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788833034.399667:0:15126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833034.399807:0:15126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994345472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (5456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833034.399816:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788833034.399951:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994345472:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788833034.400272:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788833034.518107:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788833035.465159:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e168a9c-e2a0-4132-9a92-188a53d61a6f 00010000:00010000:1.0:1788833035.544435:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833036.253899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833036.254102:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975479168 00000100:00100000:1.0:1788833036.254115:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975479168 00000100:00100000:1.0:1788833036.254215:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:1.0:1788833036.254229:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+7:13893:x1875726975479168:12345-192.168.206.41@tcp:41:lfs.0 00000004:00000024:1.0:1788833036.254287:0:15471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1788833036.254544:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833036.254788:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+7:13893:x1875726975479168:12345-192.168.206.41@tcp:41:lfs.0 Request processed in 561us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.254817:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:1.0:1788833036.261492:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833036.261626:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975479296 00000100:00100000:3.0:1788833036.261638:0:15126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975479296 00000100:00100000:3.0:1788833036.261824:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 5 00000100:00100000:3.0:1788833036.261837:0:15126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:13893:x1875726975479296:12345-192.168.206.41@tcp:13:lfs.0 00002000:00000024:3.0:1788833036.261890:0:15126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833036.262019:0:15126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:13893:x1875726975479296:12345-192.168.206.41@tcp:13:lfs.0 Request processed in 184us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833036.262028:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 5 00000100:00080000:0.0:1788833036.262315:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788833036.267494:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833036.267730:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975479424 00000100:00100000:3.0:1788833036.267764:0:15126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975479424 00000100:00100000:3.0:1788833036.267985:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:3.0:1788833036.268000:0:15126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e168a9c-e2a0-4132-9a92-188a53d61a6f+5:13893:x1875726975479424:12345-192.168.206.41@tcp:13:lfs.0 00002000:00000024:3.0:1788833036.268052:0:15126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833036.268230:0:15126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e168a9c-e2a0-4132-9a92-188a53d61a6f+5:13893:x1875726975479424:12345-192.168.206.41@tcp:13:lfs.0 Request processed in 232us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833036.268259:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00080000:0.0:1788833036.268335:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788833036.441788:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788833036.441842:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994345600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788833036.441980:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833036.442320:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994345600 00000100:00100000:1.0:1788833036.442331:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994345600 00000100:00080000:3.0:1788833036.442391:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788833036.442420:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788833036.442446:0:15126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994345600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788833036.442478:0:15126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788833036.442482:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994346112:0@lo:400:kworker.0 00000100:00100000:2.0:1788833036.442538:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.442544:0:15126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994345600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.442565:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788833036.442572:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994345984:0@lo:400:kworker.0 00000100:00100000:2.0:1788833036.442601:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833036.442602:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3314:1875726994345728:0@lo:400:kworker.0 00000100:00100000:2.0:1788833036.442630:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994346112 00000100:00100000:2.0:1788833036.442635:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994346112 00000100:00100000:0.0:1788833036.442637:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833036.442667:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994346240:0@lo:400:kworker.0 00000100:00100000:2.0:1788833036.442684:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994345984 00000100:00100000:2.0:1788833036.442687:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994345984 00000100:00100000:0.0:1788833036.442694:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833036.447500:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788833036.448001:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833036.448148:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788833036.448165:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994345856:0@lo:400:kworker.0 00000100:00100000:0.0:1788833036.448268:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833036.448323:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994345728 00000100:00100000:0.0:1788833036.448334:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994345728 00000100:00100000:0.0:1788833036.448387:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788833036.448397:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:3314:x1875726994345728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833036.448458:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:3314:x1875726994345728:12345-0@lo:400:kworker.0 Request processed in 62us (5819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.448466:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788833036.448501:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994345856 00000100:00100000:0.0:1788833036.448505:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994345856 00000100:00100000:0.0:1788833036.448557:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788833036.448564:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994345856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833036.448599:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994345856:12345-0@lo:400:kworker.0 Request processed in 36us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.448606:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788833036.448647:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788833036.448696:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994345600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788833036.448731:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994345856:0@lo:400:kworker.0 00000100:00100000:0.0:1788833036.448760:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3314:1875726994345728:0@lo:400:kworker.0 00000100:00100000:2.0:1788833036.450858:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994346240 00000100:00100000:2.0:1788833036.450883:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994346240 00000100:00100000:2.0:1788833036.451003:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788833036.451015:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994346112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833036.451145:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875726994346112:12345-0@lo:400:kworker.0 Request processed in 131us (8606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.451154:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788833036.451219:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875726994346112:0@lo:400:kworker.0 00000100:00100000:2.0:1788833036.451259:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788833036.451267:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994345984:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788833036.452313:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833036.452517:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875726994345984:12345-0@lo:400:kworker.0 Request processed in 1246us (9910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.452528:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788833036.452561:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788833036.452575:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994346240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788833036.452630:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875726994346240:12345-0@lo:400:kworker.0 Request processed in 61us (9934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.452775:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875726994346240:0@lo:400:kworker.0 00000100:00100000:0.0:1788833036.452820:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875726994345984:0@lo:400:kworker.0 00000100:00100000:2.0:1788833036.453424:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788833036.482876:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833036.488594:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975479552 00000100:00100000:1.0:1788833036.488615:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975479552 00000100:00100000:1.0:1788833036.488718:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 92 00000100:00100000:1.0:1788833036.488731:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+10:13926:x1875726975479552:12345-192.168.206.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788833036.488769:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833036.488794:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d05f04a00/0xd270a10c1c6a5ef8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55826 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.488835:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d05f04a00/0xd270a10c1c6a5ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55826 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.488848:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d05f04a00/0xd270a10c1c6a5ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55826 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833036.488858:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04a00, rc 0) 00000100:00100000:1.0:1788833036.488963:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+11:13926:x1875726975479552:12345-192.168.206.41@tcp:101:mount.lustre.0 Request processed in 234us (6101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.488972:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 92 00000100:00100000:2.0:1788833036.497165:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833036.497481:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975479680 00000100:00100000:0.0:1788833036.497495:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975479680 00000100:00100000:0.0:1788833036.497686:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 93 00000100:00100000:0.0:1788833036.497699:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0be46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+11:13926:x1875726975479680:12345-192.168.206.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788833036.498166:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0be46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+11:13926:x1875726975479680:12345-192.168.206.41@tcp:501:mount.lustre.0 Request processed in 467us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.498175:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 93 00000100:00100000:2.0:1788833036.500517:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833036.500620:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975479808 00000100:00100000:0.0:1788833036.500631:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975479808 00000100:00100000:0.0:1788833036.500698:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 94 00000100:00100000:0.0:1788833036.500710:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+11:13926:x1875726975479808:12345-192.168.206.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788833036.502655:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+11:13926:x1875726975479808:12345-192.168.206.41@tcp:503:mount.lustre.0 Request processed in 1934us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.502672:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 94 00000100:00100000:3.0:1788833036.518217:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833036.519603:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975479936 00000100:00100000:0.0:1788833036.519625:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975479936 00000100:00100000:0.0:1788833036.520018:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 95 00000100:00100000:0.0:1788833036.520049:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+11:13932:x1875726975479936:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788833036.521058:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+11:13932:x1875726975479936:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 1003us (2845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.521071:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 95 00000100:00100000:2.0:1788833036.535977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833036.536972:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975480064 00000100:00100000:0.0:1788833036.536987:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975480064 00000100:00100000:0.0:1788833036.537142:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 96 00000100:00100000:0.0:1788833036.537155:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+11:13932:x1875726975480064:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788833036.537563:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+11:13932:x1875726975480064:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 409us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.537572:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 96 00000100:00100000:2.0:1788833036.553847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833036.554011:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975480192 00000100:00100000:0.0:1788833036.554025:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975480192 00000100:00100000:0.0:1788833036.554098:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 97 00000100:00100000:0.0:1788833036.554111:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b2bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+11:13926:x1875726975480192:12345-192.168.206.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788833036.554134:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833036.554162:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d4207e200/0xd270a10c1c6a5eff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55850 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.554262:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d4207e200/0xd270a10c1c6a5eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55850 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.554276:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d4207e200/0xd270a10c1c6a5eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55850 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.554287:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d4207e200, rc 0) 00000100:00100000:0.0:1788833036.554423:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b2bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+12:13926:x1875726975480192:12345-192.168.206.41@tcp:101:mount.lustre.0 Request processed in 314us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.554432:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 97 00000100:00100000:3.0:1788833036.557043:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833036.557455:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975480320 00000100:00100000:0.0:1788833036.557467:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975480320 00000100:00100000:0.0:1788833036.557792:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 98 00000100:00100000:0.0:1788833036.557806:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+12:13926:x1875726975480320:12345-192.168.206.41@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788833036.557855:0:14430:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788833036.557886:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788833036.557890:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788833036.557893:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788833036.557896:0:14430:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788833036.559503:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+12:13926:x1875726975480320:12345-192.168.206.41@tcp:256:mount.lustre.0 Request processed in 1680us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.559520:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 98 00000100:00100000:2.0:1788833036.562364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833036.562717:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975480448 00000100:00100000:0.0:1788833036.562729:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975480448 00000100:00100000:0.0:1788833036.562852:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 99 00000100:00100000:0.0:1788833036.562865:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+12:13926:x1875726975480448:12345-192.168.206.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788833036.562888:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833036.562921:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d4207f200/0xd270a10c1c6a5f06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55857 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.562960:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d4207f200/0xd270a10c1c6a5f06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55857 expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.562974:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d4207f200/0xd270a10c1c6a5f06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55857 expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.563007:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d4207f200, rc 0) 00000100:00100000:0.0:1788833036.563329:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13926:x1875726975480448:12345-192.168.206.41@tcp:101:mount.lustre.0 Request processed in 466us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.563337:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 99 00000100:00100000:3.0:1788833036.565525:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833036.565645:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975480576 00000100:00100000:0.0:1788833036.565657:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975480576 00000100:00100000:0.0:1788833036.566061:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 100 00000100:00100000:0.0:1788833036.566075:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13926:x1875726975480576:12345-192.168.206.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788833036.566471:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13926:x1875726975480576:12345-192.168.206.41@tcp:501:mount.lustre.0 Request processed in 398us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.566481:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 100 00010000:00010000:2.0:1788833036.567154:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833036.569121:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833036.569237:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975480704 00000100:00100000:0.0:1788833036.569249:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975480704 00000100:00100000:0.0:1788833036.570808:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 101 00000100:00100000:0.0:1788833036.570835:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13926:x1875726975480704:12345-192.168.206.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788833036.571152:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13926:x1875726975480704:12345-192.168.206.41@tcp:503:mount.lustre.0 Request processed in 329us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.571161:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 101 00000100:00100000:3.0:1788833036.578447:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833036.581400:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975480832 00000100:00100000:1.0:1788833036.581424:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975480832 00000100:00100000:1.0:1788833036.581531:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 102 00000100:00100000:1.0:1788833036.581543:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13937:x1875726975480832:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788833036.582846:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13937:x1875726975480832:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 1292us (4400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.582880:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 102 00000100:00100000:3.0:1788833036.587566:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833036.589156:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975480960 00000100:00100000:0.0:1788833036.589184:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975480960 00000100:00100000:0.0:1788833036.589276:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 103 00000100:00100000:0.0:1788833036.589289:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13937:x1875726975480960:12345-192.168.206.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788833036.589646:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13937:x1875726975480960:12345-192.168.206.41@tcp:502:llog_process_th.0 Request processed in 357us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.589669:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 103 00000100:00100000:2.0:1788833036.628634:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833036.628810:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975481088 00000100:00100000:1.0:1788833036.628824:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975481088 00000100:00100000:1.0:1788833036.628887:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00100000:1.0:1788833036.628897:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2356:x1875726975481088:12345-192.168.206.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788833036.628946:0:15471:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a06b6968-6d40-447d-9c84-a3ce44653aef@192.168.206.41@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:1.0:1788833036.629000:0:15471:0:(genops.c:1385:class_connect()) connect: client a06b6968-6d40-447d-9c84-a3ce44653aef, cookie 0xd270a10c1c6a5f0d 00000004:00100000:1.0:1788833036.629047:0:15471:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788833036.629199:0:15471:0:(import.c:65:import_set_state_nolock()) ffff984d39889000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788833036.629291:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a06b6968-6d40-447d-9c84-a3ce44653aef+6:2356:x1875726975481088:12345-192.168.206.41@tcp:38:mount.lustre.0 Request processed in 393us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833036.629300:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00100000:3.0:1788833036.638211:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833036.638523:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975481344 00000100:00100000:2.0:1788833036.638537:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975481344 00000100:00080000:0.0:1788833036.638629:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833036.638641:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:2.0:1788833036.638655:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a06b6968-6d40-447d-9c84-a3ce44653aef+6:13926:x1875726975481344:12345-192.168.206.41@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788833036.638718:0:14437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788833036.638963:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a06b6968-6d40-447d-9c84-a3ce44653aef+6:13926:x1875726975481344:12345-192.168.206.41@tcp:41:mount.lustre.0 Request processed in 311us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.638972:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:3.0:1788833036.641600:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833036.643094:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975481216 00000100:00100000:0.0:1788833036.643115:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975481216 00000100:00100000:0.0:1788833036.643214:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:0.0:1788833036.643226:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a06b6968-6d40-447d-9c84-a3ce44653aef+6:0:x1875726975481216:12345-192.168.206.41@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788833036.643269:0:14439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788833036.643371:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a06b6968-6d40-447d-9c84-a3ce44653aef+6:0:x1875726975481216:12345-192.168.206.41@tcp:41:mount.lustre.0 Request processed in 147us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.643379:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:3.0:1788833036.643816:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833036.644445:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975481472 00000100:00100000:2.0:1788833036.644456:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975481472 00000100:00100000:2.0:1788833036.644514:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00100000:2.0:1788833036.644524:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+6:13926:x1875726975481472:12345-192.168.206.41@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788833036.644615:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+6:13926:x1875726975481472:12345-192.168.206.41@tcp:40:mount.lustre.0 Request processed in 92us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.644624:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00100000:3.0:1788833036.646804:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833036.646850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833036.646950:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975481600 00000100:00100000:2.0:1788833036.646971:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975481600 00000100:00100000:2.0:1788833036.647014:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975481728 00000100:00100000:2.0:1788833036.647018:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975481728 00000100:00100000:2.0:1788833036.647031:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:2.0:1788833036.647040:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1875726975481600:12345-192.168.206.41@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788833036.647072:0:15123:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a06b6968-6d40-447d-9c84-a3ce44653aef@192.168.206.41@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:2.0:1788833036.647105:0:15123:0:(genops.c:1385:class_connect()) connect: client a06b6968-6d40-447d-9c84-a3ce44653aef, cookie 0xd270a10c1c6a5f14 00002000:00100000:2.0:1788833036.647118:0:15123:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a06b6968-6d40-447d-9c84-a3ce44653aef/ffff984d3faa0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788833036.647128:0:15123:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788833036.647235:0:15123:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788833036.647268:0:15123:0:(import.c:65:import_set_state_nolock()) ffff984d08b23800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788833036.647331:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+6:2356:x1875726975481600:12345-192.168.206.41@tcp:8:mount.lustre.0 Request processed in 291us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.647338:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:2.0:1788833036.647356:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:2.0:1788833036.647458:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1875726975481728:12345-192.168.206.41@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788833036.647560:0:15123:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a06b6968-6d40-447d-9c84-a3ce44653aef@192.168.206.41@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:2.0:1788833036.647579:0:15123:0:(genops.c:1385:class_connect()) connect: client a06b6968-6d40-447d-9c84-a3ce44653aef, cookie 0xd270a10c1c6a5f1b 00002000:00100000:2.0:1788833036.647584:0:15123:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a06b6968-6d40-447d-9c84-a3ce44653aef/ffff984d08b26800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788833036.647598:0:15123:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788833036.647829:0:15123:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788833036.647848:0:15123:0:(import.c:65:import_set_state_nolock()) ffff984d08b21000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788833036.647876:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+6:2356:x1875726975481728:12345-192.168.206.41@tcp:8:mount.lustre.0 Request processed in 418us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833036.647883:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:3.0:1788833036.651727:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833036.653123:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975481856 00000100:00100000:0.0:1788833036.653134:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975481856 00000100:00100000:0.0:1788833036.653192:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 1 00000100:00100000:0.0:1788833036.653202:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+6:13926:x1875726975481856:12345-192.168.206.41@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788833036.653271:0:14441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788833036.654214:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+6:13926:x1875726975481856:12345-192.168.206.41@tcp:33:mount.lustre.0 Request processed in 1003us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.654225:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 1 00000100:00100000:1.0:1788833036.930535:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833036.930770:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975481984 00000100:00100000:0.0:1788833036.930779:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975481984 00000100:00100000:0.0:1788833036.930847:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:0.0:1788833036.930867:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a06b6968-6d40-447d-9c84-a3ce44653aef+6:13958:x1875726975481984:12345-192.168.206.41@tcp:101:mkdir.0 00010000:00010000:0.0:1788833036.930886:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833036.930908:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a5f22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55881 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.931001:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5f29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.931015:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.931026:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833036.931057:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788833036.931060:0:14439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833036.931080:0:14439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.931103:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d4207f600/0xd270a10c1c6a5f22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55881 expref: 8 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.931120:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5f29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55881 expref: 7 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833036.931128:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d06f05500) 00010000:00010000:0.0:1788833036.931131:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833036.931134:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036ba000, rc 0) 00000100:00100000:0.0:1788833036.931190:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a06b6968-6d40-447d-9c84-a3ce44653aef+7:13958:x1875726975481984:12345-192.168.206.41@tcp:101:mkdir.0 Request processed in 325us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833036.931196:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 14 00010000:00010000:1.0:1788833037.596765:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788833038.539709:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e168a9c-e2a0-4132-9a92-188a53d61a6f 00000001:00100000:2.0:1788833038.539977:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a06b6968-6d40-447d-9c84-a3ce44653aef 00010000:00010000:1.0:1788833038.613979:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788833039.327056:0:16400:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788833039.516327:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788833039.516357:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3aa3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994346368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788833039.516447:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833039.516533:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994346368 00000100:00100000:3.0:1788833039.516542:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994346368 00000100:00100000:3.0:1788833039.516608:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788833039.516618:0:15125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994346368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788833039.516669:0:15125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833039.517138:0:15125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994346368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 519us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833039.517147:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788833039.517277:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833039.517595:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3aa3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994346368:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788833039.570120:0:5875:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a06b6968-6d40-447d-9c84-a3ce44653aef 00000001:00100000:3.0:1788833039.570289:0:5875:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3e168a9c-e2a0-4132-9a92-188a53d61a6f 00010000:00010000:2.0:1788833039.647362:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788833040.565295:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a06b6968-6d40-447d-9c84-a3ce44653aef 00010000:00010000:1.0:1788833040.665144:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788833041.113195:0:14470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788833041.558682:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3316:1875726994346496:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.558801:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833041.558873:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994347008:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.558928:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833041.558955:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788833041.558961:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994346624:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.558986:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833041.559005:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994347136:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559024:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833041.559047:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994346880:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559072:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833041.559089:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788833041.559094:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994346752:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559115:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833041.559143:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994346496 00000100:00100000:0.0:1788833041.559149:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994346496 00000100:00100000:0.0:1788833041.559207:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788833041.559217:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:3316:x1875726994346496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559266:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:3316:x1875726994346496:12345-0@lo:400:kworker.0 Request processed in 50us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833041.559272:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788833041.559302:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994347008 00000100:00100000:0.0:1788833041.559306:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994347008 00000100:00100000:0.0:1788833041.559337:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994347136 00000100:00100000:0.0:1788833041.559340:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994347136 00000100:00100000:0.0:1788833041.559352:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994346880 00000100:00100000:0.0:1788833041.559354:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994346880 00000100:00100000:0.0:1788833041.559366:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788833041.559372:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994347008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559414:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994347008:12345-0@lo:400:kworker.0 Request processed in 41us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833041.559419:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788833041.559432:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788833041.559438:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994347136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559475:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875726994347136:12345-0@lo:400:kworker.0 Request processed in 37us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833041.559481:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788833041.559491:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788833041.559496:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994346880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559527:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994346880:12345-0@lo:400:kworker.0 Request processed in 31us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833041.559533:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788833041.559551:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994346624 00000100:00100000:0.0:1788833041.559555:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994346624 00000100:00100000:0.0:1788833041.559577:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994346752 00000100:00100000:0.0:1788833041.559580:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994346752 00000100:00100000:0.0:1788833041.559594:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788833041.559601:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994346624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559631:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875726994346624:12345-0@lo:400:kworker.0 Request processed in 30us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833041.559637:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788833041.559647:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788833041.559653:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994346752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559676:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994346752:12345-0@lo:400:kworker.0 Request processed in 24us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833041.559689:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788833041.559736:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994346752:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559773:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994346880:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559805:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875726994346624:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559815:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875726994347136:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559822:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3316:1875726994346496:0@lo:400:kworker.0 00000100:00100000:0.0:1788833041.559831:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994347008:0@lo:400:kworker.0 00000100:00080000:3.0:1788833041.560349:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788833041.560355:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788833041.560357:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833041.561062:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994347264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788833041.561119:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833041.561519:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994347264 00000100:00100000:1.0:1788833041.561526:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994347264 00000100:00100000:1.0:1788833041.561577:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788833041.561586:0:15125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994347264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788833041.561616:0:15125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788833041.561675:0:15125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994347264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833041.561693:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788833041.561866:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994347264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788833041.690123:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833041.757987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833041.758046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833041.758075:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833041.758096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833041.758115:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833041.758138:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833041.758170:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975482368 00000100:00100000:1.0:1788833041.758180:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975482368 00000100:00100000:1.0:1788833041.758237:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975482880 00000100:00100000:1.0:1788833041.758241:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975482880 00000100:00100000:1.0:1788833041.758259:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975482496 00000100:00100000:1.0:1788833041.758262:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975482496 00000100:00100000:1.0:1788833041.758278:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:1.0:1788833041.758289:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+5:2358:x1875726975482368:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788833041.758378:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+5:2358:x1875726975482368:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 90us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833041.758386:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:1.0:1788833041.758404:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:1.0:1788833041.758411:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+5:2358:x1875726975482880:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788833041.758437:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+5:2358:x1875726975482880:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833041.758443:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:1.0:1788833041.758455:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:1.0:1788833041.758461:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+5:2358:x1875726975482496:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788833041.758498:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+5:2358:x1875726975482496:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 36us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833041.758504:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:1.0:1788833041.758523:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975482624 00000100:00100000:1.0:1788833041.758527:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975482624 00000100:00100000:1.0:1788833041.758552:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975482240 00000100:00100000:1.0:1788833041.758555:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975482240 00000100:00100000:1.0:1788833041.758574:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 23 00000100:00100000:1.0:1788833041.758580:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+6:2358:x1875726975482624:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788833041.758607:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+6:2358:x1875726975482624:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833041.758613:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 23 00000100:00100000:1.0:1788833041.758625:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 24 00000100:00100000:1.0:1788833041.758631:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:2358:x1875726975482240:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:1.0:1788833041.758653:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:2358:x1875726975482240:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 23us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833041.758659:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 24 00000100:00080000:1.0:1788833041.758687:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788833041.758691:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788833041.758693:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833041.759214:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975482112 00000100:00100000:3.0:1788833041.759221:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975482112 00000100:00100000:3.0:1788833041.759320:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 105 00000100:00100000:3.0:1788833041.759340:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:2358:x1875726975482112:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788833041.759381:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:2358:x1875726975482112:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 54us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833041.759387:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 105 00000100:00100000:1.0:1788833041.759583:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833041.759868:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975482752 00000100:00100000:3.0:1788833041.759873:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975482752 00000100:00100000:3.0:1788833041.759924:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:3.0:1788833041.759931:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+5:2358:x1875726975482752:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788833041.759978:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+5:2358:x1875726975482752:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 47us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833041.759985:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00080000:1.0:1788833041.760170:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788833042.709958:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788833042.974523:0:16550:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0d880910 20000000:00000080:0.0:1788833042.974539:0:16550:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff984c0782b400 uarg=0000000000000000 20000000:01000000:0.0:1788833042.974772:0:16550:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788833042.974778:0:16550:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788833042.974783:0:16550:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788833042.975804:0:16551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788833042.975979:0:16550:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788833042.986234:0:16550:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788833042.989567:0:16550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.989590:0:16550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5c27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c20 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.989614:0:16550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d3ada2200/0xd270a10c1c6a5c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5c6d expref: 18 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.989622:0:16550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d3b702400/0xd270a10c1c6a5daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5da8 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.989631:0:16550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a5ece lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557f5 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.989639:0:16550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff984d4207f200/0xd270a10c1c6a5f06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55857 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.989647:0:16550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.989694:0:16550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d4207f200/0xd270a10c1c6a5f06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55857 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.989709:0:16550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d4207f200/0xd270a10c1c6a5f06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55857 expref: 12 pid: 14432 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833042.989723:0:16550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875726994347392:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788833042.989867:0:16550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a5ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557f5 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.989877:0:16550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a5ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557f5 expref: 12 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833042.989897:0:16550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875726994347520:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788833042.989938:0:16550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d3b702400/0xd270a10c1c6a5daf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a5da8 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.989947:0:16550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d3b702400/0xd270a10c1c6a5daf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a5da8 expref: 18 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833042.989957:0:16550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875726994347648:0@lo:104: 00000100:00100000:1.0:1788833042.989995:0:16550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833042.990033:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994347648 00000100:00100000:1.0:1788833042.990040:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994347648 00000100:00100000:1.0:1788833042.990096:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788833042.990106:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:16550:x1875726994347648:12345-0@lo:104: 00010000:00010000:1.0:1788833042.990117:0:14421:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5daf expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.990164:0:14421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788833042.990170:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:16550:x1875726994347648:12345-0@lo:104: Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833042.990176:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788833042.990197:0:15903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788833042.990203:0:15903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5daf expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.990210:0:15903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:1.0:1788833042.990213:0:15903:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a5daf expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.990221:0:15903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a5daf expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788833042.990239:0:15903:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a5daf expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788833042.990245:0:15903:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788833042.990271:0:15903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5daf expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.990278:0:15903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788833042.990298:0:15903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5daf expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.990305:0:15903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d3ada2400/0xd270a10c1c6a5da8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5daf expref: -99 pid: 15840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.990316:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833042.990318:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833042.990320:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788833042.990340:0:16550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d3ada2200/0xd270a10c1c6a5c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a5c6d expref: 18 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.990349:0:16550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d3ada2200/0xd270a10c1c6a5c74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a5c6d expref: 18 pid: 14431 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833042.990358:0:16550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9e6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875726994347904:0@lo:104: 00000100:00100000:1.0:1788833042.990384:0:16550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833042.990403:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994347904 00000100:00100000:1.0:1788833042.990407:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994347904 00000100:00100000:1.0:1788833042.990425:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788833042.990431:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:16550:x1875726994347904:12345-0@lo:104: 00010000:00010000:1.0:1788833042.990446:0:14421:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5c74 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.990477:0:14421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788833042.990481:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:16550:x1875726994347904:12345-0@lo:104: Request processed in 51us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833042.990487:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788833042.990513:0:16550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd270a10c1c6a5c20 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.990521:0:16550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5c27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd270a10c1c6a5c20 expref: 18 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833042.990528:0:16550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875726994348032:0@lo:104: 00000100:00100000:1.0:1788833042.990552:0:16550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833042.990576:0:14421:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788833042.990586:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994348032 00000100:00100000:1.0:1788833042.990589:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994348032 00000100:00100000:1.0:1788833042.990605:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788833042.990610:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d08a23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:16550:x1875726994348032:12345-0@lo:104: 00010000:00010000:1.0:1788833042.990618:0:14421:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5c27 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833042.990645:0:14421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788833042.990649:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d08a23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+3:16550:x1875726994348032:12345-0@lo:104: Request processed in 40us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833042.990654:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788833042.990693:0:16550:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d1862a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788833042.990713:0:16550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875726994347648:0@lo:104: 00000100:00100000:1.0:1788833042.990729:0:16550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9e6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875726994347904:0@lo:104: 00000100:00100000:1.0:1788833042.990735:0:16550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875726994348032:0@lo:104: 00010000:00010000:2.0:1788833042.990946:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788833042.990953:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5c74 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.990960:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703400 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788833042.990963:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a5c74 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.990970:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a5c74 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833042.990977:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a5c74 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833042.990982:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788833042.990998:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5c74 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991004:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833042.991029:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5c74 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991036:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d3b703400/0xd270a10c1c6a5c6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5c74 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991046:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833042.991054:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd270a10c1c6a5c27 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991061:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba200 already unused, calling callback (ffffffffc1a5fc20) 10000000:00010000:2.0:1788833042.991064:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd270a10c1c6a5c27 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991071:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd270a10c1c6a5c27 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788833042.991076:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd270a10c1c6a5c27 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833042.991082:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788833042.991096:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5c27 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991102:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788833042.991107:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5c27 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991113:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.141@tcp lock: ffff984d036ba200/0xd270a10c1c6a5c20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd270a10c1c6a5c27 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991125:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833042.991127:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833042.991129:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833042.991140:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3317:1875726994348288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833042.991171:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833042.991192:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788833042.991197:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3317:1875726994348160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833042.991225:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833042.991251:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994348288 00000100:00100000:2.0:1788833042.991254:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994348288 00010000:00010000:2.0:1788833042.991271:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5c27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5c20 expref: 19 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833042.991289:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994348160 00000100:00100000:2.0:1788833042.991291:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994348160 00010000:00010000:2.0:1788833042.991300:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d3ada2200/0xd270a10c1c6a5c74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5c6d expref: 20 pid: 14431 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833042.991311:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788833042.991316:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+20:3317:x1875726994348288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833042.991325:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833042.991330:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5c27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5c20 expref: 20 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991338:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a5c20 expref: 20 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991349:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b7d9800/0xd270a10c1c6a5c27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a5c20 expref: 20 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991360:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833042.991384:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:3317:x1875726994348288:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833042.991390:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788833042.991401:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788833042.991406:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:3317:x1875726994348160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833042.991421:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833042.991426:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d3ada2200/0xd270a10c1c6a5c74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5c6d expref: 18 pid: 14431 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991433:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d3ada2200/0xd270a10c1c6a5c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a5c6d expref: 18 pid: 14431 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991442:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3ada2200/0xd270a10c1c6a5c74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a5c6d expref: 18 pid: 14431 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.991450:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833042.991471:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:3317:x1875726994348160:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833042.991476:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788833042.991505:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3317:1875726994348160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788833042.991512:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3317:1875726994348288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788833042.992217:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d39f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3315:1875726994347776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788833042.992256:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788833042.992306:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833042.992440:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994347776 00000100:00100000:2.0:1788833042.992446:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994347776 00010000:00010000:2.0:1788833042.992470:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d3b702400/0xd270a10c1c6a5daf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5da8 expref: 17 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833042.992491:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833042.992497:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa90c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:3315:x1875726994347776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788833042.992506:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833042.992510:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d3b702400/0xd270a10c1c6a5daf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd270a10c1c6a5da8 expref: 17 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.992518:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d3b702400/0xd270a10c1c6a5daf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd270a10c1c6a5da8 expref: 17 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.992538:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b702400/0xd270a10c1c6a5daf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd270a10c1c6a5da8 expref: 17 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833042.992547:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833042.992579:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa90c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:3315:x1875726994347776:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833042.992585:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788833042.992651:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3315:1875726994347776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788833042.993395:0:16550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875726994347392:192.168.206.41@tcp:104: 00000100:00100000:0.0:1788833042.993406:0:16550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d39f2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875726994347520:192.168.206.41@tcp:104: 00010000:00010000:0.0:1788833042.993436:0:16550:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833042.997323:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833042.997382:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975483008 00000100:00100000:2.0:1788833042.997392:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975483008 00000100:00100000:1.0:1788833042.997393:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00010000:00010000:2.0:1788833042.997430:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d4207f200/0xd270a10c1c6a5f06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55857 expref: 13 pid: 14432 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833043.000219:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975483136 00000100:00100000:3.0:1788833043.000241:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975483136 00010000:00010000:3.0:1788833043.000289:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a5ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557f5 expref: 14 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833043.000333:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:3.0:1788833043.000342:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+14:2358:x1875726975483008:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833043.000355:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833043.000361:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d4207f200/0xd270a10c1c6a5f06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55857 expref: 14 pid: 14432 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000373:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d4207f200/0xd270a10c1c6a5f06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55857 expref: 14 pid: 14432 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000388:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d4207f200/0xd270a10c1c6a5f06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55857 expref: 14 pid: 14432 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000405:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833043.000466:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:2358:x1875726975483008:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 125us (3159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833043.000473:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:3.0:1788833043.000497:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:3.0:1788833043.000504:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+12:2357:x1875726975483136:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833043.000511:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833043.000529:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a5ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557f5 expref: 12 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000538:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a5ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557f5 expref: 12 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000548:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d3b702000/0xd270a10c1c6a5ece lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b557f5 expref: 12 pid: 14430 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000559:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000567:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000582:0:14424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000590:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000597:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000603:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000609:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04000 already unused, calling callback (ffffffffc1438370) 00010000:00010000:3.0:1788833043.000612:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000619:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000643:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833043.000654:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788833043.000676:0:16550:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833043.000677:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+11:2357:x1875726975483136:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 172us (3283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833043.000686:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 8 00010000:00010000:0.0:1788833043.000697:0:16550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833043.000706:0:16550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff984d05f04000/0xd270a10c1c6a5f30 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833043.736437:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788833044.118041:0:14434:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788833044.118048:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d2daa3000 from 10 10000000:01000000:0.0:1788833044.118054:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788833044.118096:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d036ba400/0xd270a10c1c6a5f37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833044.118107:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d036ba400/0xd270a10c1c6a5f37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833044.118118:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d036ba400/0xd270a10c1c6a5f37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833044.118648:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994348416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788833044.118715:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833044.118797:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d20335e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788833044.119533:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994348416 00000100:00100000:2.0:1788833044.119542:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994348416 00000100:00100000:2.0:1788833044.119598:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788833044.119607:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d40c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+16:14434:x1875726994348416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833044.119621:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833044.119637:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b702400/0xd270a10c1c6a5f3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5f37 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.119659:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b702400/0xd270a10c1c6a5f3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5f37 expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.119670:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b702400/0xd270a10c1c6a5f3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5f37 expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.119679:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702400, rc 0) 00000100:00100000:2.0:1788833044.119740:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d40c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:14434:x1875726994348416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833044.119763:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788833044.119810:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994348416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833044.119825:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d036ba400/0xd270a10c1c6a5f37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5f3e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.119834:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d036ba400/0xd270a10c1c6a5f37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5f3e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833044.119904:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994348544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833044.119934:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833044.119952:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06ba3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788833044.119965:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994348544 00000100:00100000:2.0:1788833044.119969:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994348544 00000100:00100000:2.0:1788833044.119990:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788833044.119996:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:14434:x1875726994348544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833044.120220:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:14434:x1875726994348544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833044.120227:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788833044.120262:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994348544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833044.120291:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994348672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788833044.120328:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833044.120341:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06ba3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788833044.120352:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994348672 00000100:00100000:2.0:1788833044.120355:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994348672 00000100:00100000:2.0:1788833044.120383:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788833044.120389:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:14434:x1875726994348672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788833044.120674:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:14434:x1875726994348672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 283us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833044.120682:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788833044.120726:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994348672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788833044.123141:0:16601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788833044.123926:0:14434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788833044.123951:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788833044.123964:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d036ba400/0xd270a10c1c6a5f37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5f3e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833044.123977:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d036ba400/0xd270a10c1c6a5f37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5f3e expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788833044.123989:0:14434:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788833044.123992:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d11126000 from 10 10000000:01000000:3.0:1788833044.123995:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788833044.124032:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2000/0xd270a10c1c6a5f45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833044.124040:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3ada2000/0xd270a10c1c6a5f45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833044.124051:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3ada2000/0xd270a10c1c6a5f45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833044.124073:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994348800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788833044.124133:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833044.124185:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d77840 going to sleep for 11 seconds 00000100:00100000:2.0:1788833044.124430:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994348800 00000100:00100000:2.0:1788833044.124510:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994348800 00000100:00100000:2.0:1788833044.124592:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788833044.124601:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+17:14434:x1875726994348800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833044.124614:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833044.124626:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b703400/0xd270a10c1c6a5f4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5f45 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.124650:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b703400/0xd270a10c1c6a5f4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5f45 expref: 18 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.124660:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b703400/0xd270a10c1c6a5f4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5f45 expref: 18 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.124668:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703400, rc 0) 00000100:00100000:2.0:1788833044.124720:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:14434:x1875726994348800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833044.124726:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788833044.124791:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994348800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788833044.124806:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3ada2000/0xd270a10c1c6a5f45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5f4c expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833044.124817:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3ada2000/0xd270a10c1c6a5f45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5f4c expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833044.124870:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994348928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833044.124913:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833044.126352:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d0c3e8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788833044.128817:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994348928 00000100:00100000:3.0:1788833044.128829:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994348928 00000100:00100000:3.0:1788833044.128883:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788833044.128894:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:14434:x1875726994348928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833044.129154:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:14434:x1875726994348928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (4240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833044.129162:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788833044.129730:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994348928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788833044.129820:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994349056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788833044.129870:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833044.129919:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d0c3e8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788833044.130161:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994349056 00000100:00100000:3.0:1788833044.130166:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994349056 00000100:00100000:3.0:1788833044.130206:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788833044.130225:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:14434:x1875726994349056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833044.130379:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:14434:x1875726994349056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833044.130387:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788833044.130429:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994349056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788833044.133223:0:16603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788833044.133558:0:14434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788833044.133609:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788833044.133621:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3ada2000/0xd270a10c1c6a5f45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5f4c expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.133669:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3ada2000/0xd270a10c1c6a5f45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5f4c expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788833044.133682:0:14434:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788833044.133684:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff984d1198f000 from 10 10000000:01000000:2.0:1788833044.133688:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788833044.133771:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702000/0xd270a10c1c6a5f53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.133779:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.141@tcp lock: ffff984d3b702000/0xd270a10c1c6a5f53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.133810:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.141@tcp lock: ffff984d3b702000/0xd270a10c1c6a5f53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833044.133850:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994349184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788833044.133925:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833044.133954:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06ba33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833044.133975:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994349184 00000100:00100000:2.0:1788833044.133981:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994349184 00000100:00100000:2.0:1788833044.134021:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788833044.134029:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+18:14434:x1875726994349184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833044.134041:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833044.134051:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b702600/0xd270a10c1c6a5f5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd270a10c1c6a5f53 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.134072:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b702600/0xd270a10c1c6a5f5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd270a10c1c6a5f53 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.134095:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b702600/0xd270a10c1c6a5f5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd270a10c1c6a5f53 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.134103:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702600, rc 0) 00000100:00100000:2.0:1788833044.134169:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:14434:x1875726994349184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833044.134175:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788833044.134261:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994349184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833044.134287:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.141@tcp lock: ffff984d3b702000/0xd270a10c1c6a5f53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5f5a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.134296:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.141@tcp lock: ffff984d3b702000/0xd270a10c1c6a5f53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd270a10c1c6a5f5a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833044.134343:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ace6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994349312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833044.134367:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788833044.134380:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06ba33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788833044.134392:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994349312 00000100:00100000:2.0:1788833044.134395:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994349312 00000100:00100000:2.0:1788833044.134415:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788833044.134421:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:14434:x1875726994349312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788833044.136027:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:14434:x1875726994349312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1600us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833044.136039:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788833044.136190:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ace6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994349312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833044.136237:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994349440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833044.136337:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833044.136401:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d77180 going to sleep for 11 seconds 00000100:00100000:2.0:1788833044.136511:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994349440 00000100:00100000:2.0:1788833044.136517:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994349440 00000100:00100000:3.0:1788833044.137584:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788833044.137598:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:14434:x1875726994349440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833044.138546:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:14434:x1875726994349440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 948us (2229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833044.138569:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788833044.138698:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:14434:1875726994349440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788833044.152347:0:16604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788833044.152788:0:14434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788833044.152810:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788833044.152822:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.141@tcp lock: ffff984d3b702000/0xd270a10c1c6a5f53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5f5a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.152835:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.141@tcp lock: ffff984d3b702000/0xd270a10c1c6a5f53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd270a10c1c6a5f5a expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833044.636471:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984c04ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994349568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788833044.636550:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833044.636768:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994349568 00000100:00100000:3.0:1788833044.636776:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994349568 00000100:00100000:3.0:1788833044.636840:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788833044.636849:0:15125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994349568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788833044.636889:0:15125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788833044.640011:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833044.644230:0:15125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994349568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7373us (7671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833044.644246:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788833044.644920:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984c04ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994349568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788833044.711925:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833044.712361:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975483264 00000100:00100000:2.0:1788833044.712371:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975483264 00000100:00100000:2.0:1788833044.712434:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 115 00000100:00100000:2.0:1788833044.712444:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+11:13811:x1875726975483264:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788833044.712461:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833044.712478:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d3b703e00/0xd270a10c1c6a5f61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55888 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.712505:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d3b703e00/0xd270a10c1c6a5f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55888 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.712517:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d3b703e00/0xd270a10c1c6a5f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55888 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833044.712538:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703e00, rc 0) 00000100:00100000:2.0:1788833044.712607:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40885574-0d1f-4d1b-98c1-89cfcedce8f0+12:13811:x1875726975483264:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 Request processed in 164us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833044.712614:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 115 00000100:00100000:3.0:1788833044.718182:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833044.718303:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975483392 00000100:00100000:0.0:1788833044.718396:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975483392 00000100:00100000:0.0:1788833044.718455:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 116 00000100:00100000:0.0:1788833044.718463:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+12:13811:x1875726975483392:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788833044.720381:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+12:13811:x1875726975483392:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 Request processed in 1910us (2198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833044.720420:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 116 00000100:00100000:1.0:1788833044.733273:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833044.733405:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975483520 00000100:00100000:3.0:1788833044.733414:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975483520 00000100:00100000:3.0:1788833044.733467:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 117 00000100:00100000:3.0:1788833044.733477:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+12:13811:x1875726975483520:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833044.733684:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+12:13811:x1875726975483520:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 Request processed in 208us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833044.733692:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 117 00000100:00100000:2.0:1788833044.749721:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833044.749901:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975483648 00000100:00100000:0.0:1788833044.749911:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975483648 00000100:00100000:0.0:1788833044.749967:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 118 00000100:00100000:0.0:1788833044.749977:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+12:13811:x1875726975483648:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788833044.749992:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833044.750009:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff984d036ba200/0xd270a10c1c6a5f68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5588f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833044.750036:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff984d036ba200/0xd270a10c1c6a5f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5588f expref: 13 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833044.750047:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff984d036ba200/0xd270a10c1c6a5f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5588f expref: 13 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833044.750056:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036ba200, rc 0) 00000100:00100000:0.0:1788833044.750123:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13811:x1875726975483648:12345-192.168.206.41@tcp:101:ll_cfg_requeue.0 Request processed in 138us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833044.750130:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 118 00010000:00010000:2.0:1788833044.758534:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788833044.765127:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833044.765349:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975483776 00000100:00100000:3.0:1788833044.765358:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975483776 00000100:00100000:3.0:1788833044.765694:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 119 00000100:00100000:3.0:1788833044.765705:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13811:x1875726975483776:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788833044.768199:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13811:x1875726975483776:12345-192.168.206.41@tcp:501:ll_cfg_requeue.0 Request processed in 2488us (3071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833044.768211:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 119 00000100:00100000:2.0:1788833044.785757:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833044.792394:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975483904 00000100:00100000:3.0:1788833044.792428:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975483904 00000100:00100000:3.0:1788833044.792659:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 120 00000100:00100000:3.0:1788833044.792670:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13811:x1875726975483904:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788833044.793077:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:13811:x1875726975483904:12345-192.168.206.41@tcp:503:ll_cfg_requeue.0 Request processed in 407us (7340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833044.793085:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 120 00010000:00010000:0.0:1788833045.782259:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833046.377417:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.377599:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975484032 00000100:00100000:0.0:1788833046.377609:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975484032 00000100:00100000:0.0:1788833046.377683:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:0.0:1788833046.377694:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:14469:x1875726975484032:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833046.377711:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833046.377730:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a5f6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55896 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.377840:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.377855:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.377877:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.377891:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.377898:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.377904:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378206:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5f84 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378215:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5f84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378223:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5f84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833046.378244:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788833046.378248:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833046.378280:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5f84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378301:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378306:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378313:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378319:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833046.378324:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378331:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378354:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d06f05500) 00010000:00010000:0.0:1788833046.378357:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833046.378361:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378368:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378380:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378386:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378391:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378402:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036baa00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833046.378405:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378412:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378420:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff984d0b543e00) 00010000:00010000:0.0:1788833046.378422:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833046.378425:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378431:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378461:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a5f6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55896 expref: 8 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378473:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb000/0xd270a10c1c6a5f84 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55896 expref: 7 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.378479:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff984d0b543c00) 00010000:00010000:0.0:1788833046.378481:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833046.378484:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bb000, rc 0) 00000100:00100000:0.0:1788833046.378544:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+7:14469:x1875726975484032:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 852us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833046.378551:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00080000:1.0:1788833046.379032:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788833046.383404:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.383556:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975484288 00000100:00100000:0.0:1788833046.383578:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975484288 00000100:00100000:0.0:1788833046.383635:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:0.0:1788833046.383644:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+7:14469:x1875726975484288:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833046.383666:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833046.383688:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a5f8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5589d expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.383782:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f92 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.383800:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.383812:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.383828:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.383835:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.383841:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384202:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5fa0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384211:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384218:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833046.384233:0:15471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788833046.384506:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384514:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f92 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384521:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384527:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036baa00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833046.384531:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384538:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f92 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384550:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff984d0b543c00) 00010000:00010000:0.0:1788833046.384553:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833046.384557:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384562:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5f92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384574:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384581:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f99 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384598:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384603:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833046.384605:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384611:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f99 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384619:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff984d0b543e00) 00010000:00010000:0.0:1788833046.384622:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833046.384625:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f99 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.384630:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5f99 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.385194:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a5f8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5589d expref: 10 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.385210:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb600/0xd270a10c1c6a5fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5589d expref: 9 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.385218:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d0b543700) 00010000:00010000:0.0:1788833046.385220:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833046.385223:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bb600, rc 0) 00000100:00100000:0.0:1788833046.385300:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:14469:x1875726975484288:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 1655us (1903us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788833046.385317:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:3.0:1788833046.389795:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833046.389889:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975484416 00000100:00100000:1.0:1788833046.389898:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975484416 00000100:00100000:1.0:1788833046.389968:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 17 00000100:00100000:1.0:1788833046.389979:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:14469:x1875726975484416:12345-192.168.206.41@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788833046.390071:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:14469:x1875726975484416:12345-192.168.206.41@tcp:59:lhsmtool_posix.0 Request processed in 94us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833046.390079:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 17 00000100:00100000:3.0:1788833046.459998:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833046.462436:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975484544 00000100:00100000:1.0:1788833046.464472:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975484544 00000100:00100000:1.0:1788833046.464559:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 18 00000100:00100000:1.0:1788833046.464569:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:14475:x1875726975484544:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:1.0:1788833046.464589:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833046.464610:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5fae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558a4 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464673:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464688:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464701:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464715:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a5fbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464721:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a5fbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464728:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a5fbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464933:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464941:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464948:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464953:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788833046.464957:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464964:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464975:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d06f05500) 00010000:00010000:1.0:1788833046.464978:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833046.464982:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464987:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.464999:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a5fbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.465005:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a5fbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.465010:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a5fbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.465021:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788833046.465024:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a5fbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.465030:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a5fbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.465039:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff984d0a93b800) 00010000:00010000:1.0:1788833046.465041:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833046.465044:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a5fbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.465049:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a5fbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.465079:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5fae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558a4 expref: 10 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.465088:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d06f05500) 00010000:00010000:1.0:1788833046.465091:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833046.465094:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a5fae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558a4 expref: 10 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.465104:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04c00, rc 0) 00000100:00100000:1.0:1788833046.465166:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:14475:x1875726975484544:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 599us (5177us total) trans 0 rc 301/301 00000100:00100000:1.0:1788833046.465174:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 18 00000100:00100000:1.0:1788833046.470417:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.474241:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975484672 00000100:00100000:0.0:1788833046.474254:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975484672 00000100:00100000:0.0:1788833046.474875:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00100000:0.0:1788833046.474889:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:14475:x1875726975484672:12345-192.168.206.41@tcp:700:lfs.0 00000100:00100000:0.0:1788833046.474994:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:14475:x1875726975484672:12345-192.168.206.41@tcp:700:lfs.0 Request processed in 108us (4586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833046.475002:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00100000:2.0:1788833046.478888:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833046.478956:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975484928 00000100:00100000:1.0:1788833046.478967:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975484928 00000100:00100000:1.0:1788833046.479016:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 19 00000100:00100000:1.0:1788833046.479025:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:14475:x1875726975484928:12345-192.168.206.41@tcp:36:lfs.0 00010000:00010000:1.0:1788833046.479077:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788833046.479114:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a5ef1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5581f expref: 9 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.479143:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d06f05500) 00010000:00010000:1.0:1788833046.479148:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788833046.479352:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.479366:0:14438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5f29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55881 expref: 5 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.479374:0:14438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.479405:0:14438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5f29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55881 expref: 5 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.479418:0:14438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5f29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55881 expref: 5 pid: 14439 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833046.479430:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1875726994349696:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788833046.479536:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d031fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1788833046.481328:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1875726994349696:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788833046.481363:0:14438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833046.482687:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.486481:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975485056 00000100:00100000:0.0:1788833046.486495:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975485056 00010000:00010000:0.0:1788833046.486554:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5f29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55881 expref: 6 pid: 14439 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833046.486585:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:0.0:1788833046.486593:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a06b6968-6d40-447d-9c84-a3ce44653aef+6:2358:x1875726975485056:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833046.486606:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833046.486612:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5f29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55881 expref: 6 pid: 14439 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.486625:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5f29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55881 expref: 6 pid: 14439 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.486645:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a5f29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55881 expref: 6 pid: 14439 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.486659:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d06f05500) 00010000:00010000:0.0:1788833046.486675:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.486683:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.486689:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.486712:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833046.486900:0:14438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.486909:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.486932:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702800/0xd270a10c1c6a5fca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.486940:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702800/0xd270a10c1c6a5fca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.486948:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702800/0xd270a10c1c6a5fca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833046.488407:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788833046.488421:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.488436:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.488443:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.488449:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788833046.488453:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.488460:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.488474:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d06f05500) 00010000:00010000:2.0:1788833046.488476:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833046.488480:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.488485:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a5fc3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833046.488504:0:14438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2104d88 reply state 00000000e07e2b36 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702800/0xd270a10c1c6a5fca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833046.488512:0:14438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:1.0:1788833046.488971:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788833046.490916:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a06b6968-6d40-447d-9c84-a3ce44653aef+5:2358:x1875726975485056:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 4312us (8222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833046.490930:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:2.0:1788833046.491255:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+10:14475:x1875726975484928:12345-192.168.206.41@tcp:36:lfs.0 Request processed in 12229us (12375us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788833046.491264:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 19 00010000:00010000:2.0:1788833046.503543:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702800/0xd270a10c1c6a5fca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.503573:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702800/0xd270a10c1c6a5fca lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.503581:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702800/0xd270a10c1c6a5fca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.503587:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788833046.503592:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702800/0xd270a10c1c6a5fca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.503599:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702800/0xd270a10c1c6a5fca lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.503615:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff984d06f05400) 00010000:00010000:2.0:1788833046.503618:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833046.503623:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702800/0xd270a10c1c6a5fca lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.503629:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702800/0xd270a10c1c6a5fca lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833046.652441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833046.652547:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975485184 00000100:00100000:1.0:1788833046.652557:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975485184 00000100:00100000:1.0:1788833046.652617:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 20 00000100:00100000:1.0:1788833046.652627:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:14483:x1875726975485184:12345-192.168.206.41@tcp:101:lctl.0 00010000:00010000:1.0:1788833046.652649:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833046.652671:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a5fd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558ab expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.652731:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.652790:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.652812:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833046.652845:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788833046.652848:0:14437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833046.652895:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.652919:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a5fd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ab expref: 11 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.652937:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05000/0xd270a10c1c6a5fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ab expref: 10 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833046.652945:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0a93b800) 00010000:00010000:1.0:1788833046.652948:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788833046.652964:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05000, rc 0) 00000100:00100000:1.0:1788833046.653024:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+10:14483:x1875726975485184:12345-192.168.206.41@tcp:101:lctl.0 Request processed in 398us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833046.653031:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 20 00000100:00100000:1.0:1788833046.675675:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833046.675897:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975485312 00000100:00100000:3.0:1788833046.675907:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975485312 00000100:00100000:3.0:1788833046.675963:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 21 00000100:00100000:3.0:1788833046.675974:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a06b6968-6d40-447d-9c84-a3ce44653aef+5:14484:x1875726975485312:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:3.0:1788833046.675993:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833046.676016:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5fdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558b2 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.676070:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a5fe6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.676084:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a5fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.676094:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a5fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833046.676123:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788833046.676138:0:14439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788833046.676159:0:14439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a5fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.676196:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a5fdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558b2 expref: 7 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.676213:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2a00/0xd270a10c1c6a5fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558b2 expref: 6 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.676222:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0a93b800) 00010000:00010000:3.0:1788833046.676225:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788833046.676228:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2a00, rc 0) 00000100:00100000:3.0:1788833046.676288:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a06b6968-6d40-447d-9c84-a3ce44653aef+6:14484:x1875726975485312:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 316us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.676295:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 21 00000100:00100000:0.0:1788833046.679573:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3a9e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994349824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788833046.679582:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994350208:0@lo:400:kworker.0 00000100:00100000:2.0:1788833046.679637:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833046.679637:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833046.679707:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994349824 00000100:00100000:3.0:1788833046.679716:0:15126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994349824 00000100:00100000:3.0:1788833046.679800:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788833046.679810:0:15126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984c04ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994349824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788833046.679842:0:15126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788833046.679893:0:15126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984c04ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994349824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.679900:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788833046.679922:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788833046.679923:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3a9e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994349824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788833046.679930:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994350336:0@lo:400:kworker.0 00000100:00100000:3.0:1788833046.679944:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3316:1875726994349952:0@lo:400:kworker.0 00000100:00100000:0.0:1788833046.679954:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833046.679970:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833046.679991:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994350464:0@lo:400:kworker.0 00000100:00100000:0.0:1788833046.679999:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994350080:0@lo:400:kworker.0 00000100:00100000:3.0:1788833046.680011:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833046.680018:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833046.680034:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994350592:0@lo:400:kworker.0 00000100:00100000:3.0:1788833046.680049:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994349952 00000100:00100000:0.0:1788833046.680051:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833046.680053:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994349952 00000100:00100000:3.0:1788833046.680075:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788833046.680081:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:3316:x1875726994349952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833046.680083:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994350208 00000100:00100000:0.0:1788833046.680086:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994350208 00000100:00100000:0.0:1788833046.680108:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994350080 00000100:00100000:0.0:1788833046.680111:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994350080 00000100:00100000:3.0:1788833046.680114:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2036b91a-7b7b-4a70-ac28-9ff58ee109ad+19:3316:x1875726994349952:12345-0@lo:400:kworker.0 Request processed in 34us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.680121:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788833046.680129:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788833046.680135:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994350208:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788833046.680154:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833046.680169:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2036b91a-7b7b-4a70-ac28-9ff58ee109ad:3316:1875726994349952:0@lo:400:kworker.0 00000100:00100000:0.0:1788833046.680169:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875726994350208:12345-0@lo:400:kworker.0 Request processed in 35us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833046.680176:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788833046.680189:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788833046.680190:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994350336 00000100:00100000:3.0:1788833046.680193:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994350336 00000100:00100000:0.0:1788833046.680194:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994350080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833046.680215:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994350464 00000100:00100000:3.0:1788833046.680218:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994350464 00000100:00100000:0.0:1788833046.680221:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875726994350080:12345-0@lo:400:kworker.0 Request processed in 28us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833046.680227:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788833046.680233:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994350592 00000100:00100000:3.0:1788833046.680235:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994350592 00000100:00100000:3.0:1788833046.680247:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788833046.680249:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875726994350080:0@lo:400:kworker.0 00000100:00100000:3.0:1788833046.680252:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994350336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833046.680267:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788833046.680273:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994350464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788833046.680284:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875726994350336:12345-0@lo:400:kworker.0 Request processed in 32us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.680290:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788833046.680302:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788833046.680303:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875726994350464:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.680307:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994350592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788833046.680309:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788833046.680335:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875726994350592:12345-0@lo:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.680341:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788833046.680353:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875726994350336:0@lo:400:kworker.0 00000100:00080000:3.0:1788833046.680354:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788833046.680367:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875726994350592:0@lo:400:kworker.0 00000100:00100000:3.0:1788833046.680400:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875726994350464:0@lo:400:kworker.0 00000100:00100000:2.0:1788833046.682264:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875726994350208:0@lo:400:kworker.0 00000100:00100000:2.0:1788833046.684153:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.684217:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975485440 00000100:00100000:0.0:1788833046.684226:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975485440 00000100:00100000:0.0:1788833046.684279:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 22 00000100:00100000:0.0:1788833046.684289:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a06b6968-6d40-447d-9c84-a3ce44653aef+6:14484:x1875726975485440:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788833046.684318:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833046.684336:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a5fed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558b9 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.684557:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5ff4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.684588:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.684599:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.684614:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5ffb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.684620:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5ffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.684625:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5ffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685006:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a6002 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685016:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a6002 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685024:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a6002 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833046.685054:0:15471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788833046.685058:0:15471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833046.685076:0:15471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a6002 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685087:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685102:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5ff4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685109:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685114:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833046.685118:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685495:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5ff4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685512:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0a93b800) 00010000:00010000:0.0:1788833046.685515:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833046.685519:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5ff4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685525:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a5ff4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685537:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5ffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685543:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5ffb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685547:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5ffb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685552:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036baa00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833046.685560:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5ffb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685567:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5ffb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685574:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff984d0b543e00) 00010000:00010000:0.0:1788833046.685576:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833046.685579:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5ffb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685583:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a5ffb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685615:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a5fed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558b9 expref: 8 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685627:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a6002 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558b9 expref: 7 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.685633:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984d0b543800) 00010000:00010000:0.0:1788833046.685635:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833046.685637:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bbc00, rc 0) 00000100:00100000:0.0:1788833046.686507:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a06b6968-6d40-447d-9c84-a3ce44653aef+7:14484:x1875726975485440:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 2213us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833046.686516:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 22 00000100:00100000:1.0:1788833046.700084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.700243:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975485696 00000100:00100000:0.0:1788833046.700254:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975485696 00000100:00100000:0.0:1788833046.700345:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 23 00000100:00100000:0.0:1788833046.700363:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+7:14484:x1875726975485696:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788833046.700394:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833046.700412:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a6009 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558c0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833046.700494:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788833046.700599:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a6009 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558c0 expref: 9 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.700612:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0a93b800) 00010000:00010000:0.0:1788833046.700614:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788833046.700618:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a6009 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558c0 expref: 9 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.700631:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036ba600, rc 0) 00000100:00100000:0.0:1788833046.700690:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+8:14484:x1875726975485696:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 336us (613us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788833046.700696:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 23 00000100:00100000:1.0:1788833046.708582:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833046.708993:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975485952 00000100:00100000:3.0:1788833046.709003:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975485952 00000100:00100000:3.0:1788833046.709050:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 24 00000100:00100000:3.0:1788833046.709059:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a06b6968-6d40-447d-9c84-a3ce44653aef+8:14484:x1875726975485952:12345-192.168.206.41@tcp:36:lfs.0 00010000:00010000:3.0:1788833046.709108:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833046.709132:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a6002 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558b9 expref: 8 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.709151:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984d0b543800) 00010000:00010000:3.0:1788833046.709161:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788833046.709185:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a6017 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.709199:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a6017 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.709209:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a6017 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788833046.709425:0:14439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ee6c228 reply state 00000000ce87dd3f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a6017 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833046.709434:0:14439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788833046.709442:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788833046.709519:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a06b6968-6d40-447d-9c84-a3ce44653aef+9:14484:x1875726975485952:12345-192.168.206.41@tcp:36:lfs.0 Request processed in 460us (946us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788833046.709527:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 24 00010000:00010000:0.0:1788833046.711882:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a6017 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.711898:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a6017 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.711905:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a6017 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.711910:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833046.711914:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a6017 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.711938:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a6017 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.711953:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984d07e81e00) 00010000:00010000:0.0:1788833046.711955:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788833046.711960:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a6017 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.711967:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a6017 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833046.712040:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.712103:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975486208 00000100:00100000:0.0:1788833046.712110:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975486208 00000100:00100000:0.0:1788833046.712150:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 2 00000100:00100000:0.0:1788833046.712159:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+8:14484:x1875726975486208:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:0.0:1788833046.712380:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+9:14484:x1875726975486208:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 221us (342us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788833046.712388:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 2 00000100:00100000:1.0:1788833046.714805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833046.715142:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975486464 00000100:00100000:2.0:1788833046.715168:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975486464 00000100:00100000:2.0:1788833046.715236:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 25 00000100:00100000:2.0:1788833046.715248:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a06b6968-6d40-447d-9c84-a3ce44653aef+9:14484:x1875726975486464:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788833046.715277:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833046.715303:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a601e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558c7 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715393:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6025 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715411:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6025 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715425:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6025 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715441:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a602c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715449:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a602c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715456:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a602c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833046.715590:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788833046.715702:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6025 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715710:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6025 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715730:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6025 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715736:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788833046.715766:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6025 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715778:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6025 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715793:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0a93b800) 00010000:00010000:2.0:1788833046.715796:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833046.715801:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6025 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715808:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6025 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715824:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a602c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715831:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a602c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715837:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a602c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715843:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788833046.715846:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a602c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715872:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a602c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715880:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff984d06f05400) 00010000:00010000:2.0:1788833046.715882:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833046.715885:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a602c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715890:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a602c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715934:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a601e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558c7 expref: 11 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715946:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0a93b800) 00010000:00010000:2.0:1788833046.715948:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788833046.715952:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a601e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558c7 expref: 11 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.715963:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702a00, rc 0) 00000100:00100000:2.0:1788833046.716047:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a06b6968-6d40-447d-9c84-a3ce44653aef+10:14484:x1875726975486464:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 800us (1254us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788833046.716056:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 25 00000100:00100000:1.0:1788833046.723191:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833046.723319:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975486592 00000100:00100000:3.0:1788833046.723341:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975486592 00000100:00100000:3.0:1788833046.723396:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 26 00000100:00100000:3.0:1788833046.723406:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a06b6968-6d40-447d-9c84-a3ce44653aef+10:14484:x1875726975486592:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:3.0:1788833046.723428:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833046.723450:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a603a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558ce expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.723534:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a6041 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.723547:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a6041 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.723557:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a6041 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833046.723582:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788833046.723586:0:14439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788833046.723602:0:14439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a6041 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.723627:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a603a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ce expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.723644:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a6041 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ce expref: 11 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.723653:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984d07e81c00) 00010000:00010000:3.0:1788833046.723655:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788833046.723659:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3e00, rc 0) 00000100:00100000:3.0:1788833046.723725:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a06b6968-6d40-447d-9c84-a3ce44653aef+11:14484:x1875726975486592:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 320us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.723733:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 26 00000100:00100000:1.0:1788833046.726587:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833046.726660:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975486720 00000100:00100000:3.0:1788833046.726671:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975486720 00000100:00100000:3.0:1788833046.726727:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 3 00000100:00100000:3.0:1788833046.726736:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a06b6968-6d40-447d-9c84-a3ce44653aef+11:14484:x1875726975486720:12345-192.168.206.41@tcp:37:lfs.0 00000100:00100000:2.0:1788833046.733432:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a06b6968-6d40-447d-9c84-a3ce44653aef+11:14484:x1875726975486720:12345-192.168.206.41@tcp:37:lfs.0 Request processed in 6687us (6842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833046.733447:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 3 00000100:00100000:1.0:1788833046.736459:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.736646:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975486976 00000100:00100000:0.0:1788833046.736656:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975486976 00000100:00100000:0.0:1788833046.736710:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 4 00000100:00100000:0.0:1788833046.736719:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398bb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+11:14484:x1875726975486976:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:0.0:1788833046.737232:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398bb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+12:14484:x1875726975486976:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 512us (779us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788833046.737241:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 4 00000100:00100000:1.0:1788833046.793012:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.793102:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975487104 00000100:00100000:0.0:1788833046.793111:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975487104 00000100:00100000:0.0:1788833046.793187:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 27 00000100:00100000:0.0:1788833046.793196:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+10:14490:x1875726975487104:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:0.0:1788833046.793215:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833046.793235:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a6048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558d5 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793296:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a604f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793321:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a604f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793332:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a604f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793346:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6056 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793353:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793360:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793444:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a605d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793452:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a605d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793459:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a605d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833046.793494:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788833046.793497:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833046.793532:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a605d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793542:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a604f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793548:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a604f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793555:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a604f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793560:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036baa00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833046.793564:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a604f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793570:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a604f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793581:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0a93b800) 00010000:00010000:0.0:1788833046.793584:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833046.793588:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a604f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793594:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a604f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793606:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793620:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6056 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793625:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793629:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bb800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833046.793632:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793638:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6056 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793646:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff984d0b543e00) 00010000:00010000:0.0:1788833046.793648:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833046.793651:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6056 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793656:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6056 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793684:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a6048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558d5 expref: 12 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793698:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbc00/0xd270a10c1c6a605d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558d5 expref: 11 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.793705:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984d07e81c00) 00010000:00010000:0.0:1788833046.793707:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788833046.793716:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bbc00, rc 0) 00000100:00100000:0.0:1788833046.794260:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+11:14490:x1875726975487104:12345-192.168.206.41@tcp:101:bash.0 Request processed in 1063us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833046.794268:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 27 00010000:00010000:1.0:1788833046.806236:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833046.806637:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833046.806705:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975487360 00000100:00100000:3.0:1788833046.806715:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975487360 00000100:00100000:3.0:1788833046.806802:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 28 00000100:00100000:3.0:1788833046.806813:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+11:14490:x1875726975487360:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:3.0:1788833046.806832:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833046.806850:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a6064 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558dc expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.806967:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.806983:0:14439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a6041 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ce expref: 11 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.806991:0:14439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.807022:0:14439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a6041 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ce expref: 11 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.807035:0:14439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a6041 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ce expref: 11 pid: 14439 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833046.807062:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b92e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1875726994350720:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788833046.807234:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c07b8c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788833046.809801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.809901:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975487488 00000100:00100000:0.0:1788833046.809962:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975487488 00010000:00010000:0.0:1788833046.809997:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a6041 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ce expref: 12 pid: 14439 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833046.810029:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00100000:0.0:1788833046.810037:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+12:2357:x1875726975487488:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833046.810049:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833046.810054:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a6041 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ce expref: 12 pid: 14439 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.810066:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a6041 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ce expref: 12 pid: 14439 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.810085:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984d07e81c00) 00010000:00010000:0.0:1788833046.810090:0:14423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.810099:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.810106:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.810123:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833046.810192:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a06b6968-6d40-447d-9c84-a3ce44653aef+12:2357:x1875726975487488:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 155us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833046.810200:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 10 00010000:00010000:3.0:1788833046.810899:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3e00/0xd270a10c1c6a6041 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ce expref: 11 pid: 14439 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833046.810918:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b92e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1875726994350720:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788833046.810939:0:14439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.810948:0:14439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.810954:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.811021:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a6072 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.811032:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a6072 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.811041:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a6072 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.812924:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a6079 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.812941:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a6079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.812961:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a6079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833046.812973:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788833046.813003:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.813009:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.813016:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.813022:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada3600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:3.0:1788833046.813027:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.813034:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.813046:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984d07e81c00) 00010000:00010000:3.0:1788833046.813049:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788833046.813053:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.813060:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a606b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788833046.813073:0:14439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4835602 reply state 000000005c7ec591 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a6072 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833046.813093:0:14439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788833046.813128:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a6064 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558dc expref: 14 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.813144:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a6079 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558dc expref: 13 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.813151:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:3.0:1788833046.813153:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788833046.813156:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada2400, rc 0) 00000100:00100000:3.0:1788833046.813219:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+14:14490:x1875726975487360:12345-192.168.206.41@tcp:101:bash.0 Request processed in 6407us (6586us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788833046.813228:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 28 00010000:00010000:2.0:1788833046.822484:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a6072 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.822512:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a6072 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.822519:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a6072 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.822525:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3ada2200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788833046.822529:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a6072 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.822536:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a6072 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.822551:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff984d07e81700) 00010000:00010000:2.0:1788833046.822555:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833046.822559:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a6072 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.822565:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2200/0xd270a10c1c6a6072 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833046.826598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833046.826681:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975487616 00000100:00100000:2.0:1788833046.826690:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975487616 00000100:00100000:2.0:1788833046.826778:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 29 00000100:00100000:2.0:1788833046.826789:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+13:14490:x1875726975487616:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:2.0:1788833046.826812:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833046.826830:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a6087 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558e3 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.826925:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a608e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.826939:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a608e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.826950:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a608e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833046.826988:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788833046.826993:0:14437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833046.827015:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a608e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.827025:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a608e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.827049:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702a00/0xd270a10c1c6a6087 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558e3 expref: 15 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.827067:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a608e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558e3 expref: 14 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.827076:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:2.0:1788833046.827079:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833046.827082:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702e00, rc 0) 00000100:00100000:2.0:1788833046.827144:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+14:14490:x1875726975487616:12345-192.168.206.41@tcp:101:bash.0 Request processed in 357us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833046.827151:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 29 00000100:00100000:1.0:1788833046.831122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.831201:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975487872 00000100:00100000:0.0:1788833046.831210:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975487872 00000100:00100000:0.0:1788833046.831265:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 5 00000100:00100000:0.0:1788833046.831274:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+14:14490:x1875726975487872:12345-192.168.206.41@tcp:35:bash.0 00000100:00100000:0.0:1788833046.831602:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+15:14490:x1875726975487872:12345-192.168.206.41@tcp:35:bash.0 Request processed in 328us (487us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788833046.831610:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 5 00000100:00100000:1.0:1788833046.880238:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833046.880647:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833046.880878:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833046.880907:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833046.880971:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975488000 00000100:00100000:2.0:1788833046.880984:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975488000 00000100:00100000:2.0:1788833046.881048:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 122 00000100:00100000:2.0:1788833046.881060:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d181e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:2358:x1875726975488000:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:2.0:1788833046.881165:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d181e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40885574-0d1f-4d1b-98c1-89cfcedce8f0+13:2358:x1875726975488000:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 107us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833046.881173:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 122 00000100:00100000:0.0:1788833046.881399:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975488128 00000100:00100000:0.0:1788833046.881405:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975488128 00000100:00080000:2.0:1788833046.881489:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833046.881793:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975488384 00000100:00100000:3.0:1788833046.881798:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975488384 00000100:00100000:3.0:1788833046.881851:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:3.0:1788833046.881872:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+5:2358:x1875726975488128:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788833046.881923:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+5:2358:x1875726975488128:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 64us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.881931:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:3.0:1788833046.881948:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00100000:3.0:1788833046.881955:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a06b6968-6d40-447d-9c84-a3ce44653aef+5:2358:x1875726975488384:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788833046.881983:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a06b6968-6d40-447d-9c84-a3ce44653aef+5:2358:x1875726975488384:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 28us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.881989:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00080000:2.0:1788833046.882161:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833046.882520:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975488256 00000100:00100000:3.0:1788833046.882526:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975488256 00000100:00100000:3.0:1788833046.882644:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:3.0:1788833046.882651:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+5:2358:x1875726975488256:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788833046.882687:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+5:2358:x1875726975488256:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 36us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.882694:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:1.0:1788833046.883110:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833046.883315:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975488512 00000100:00100000:3.0:1788833046.883321:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975488512 00000100:00080000:2.0:1788833046.883602:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788833046.883776:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:3.0:1788833046.883785:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a06b6968-6d40-447d-9c84-a3ce44653aef+5:2358:x1875726975488512:12345-192.168.206.41@tcp:400:kworker.0 00000100:00100000:3.0:1788833046.883898:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a06b6968-6d40-447d-9c84-a3ce44653aef+5:2358:x1875726975488512:12345-192.168.206.41@tcp:400:kworker.0 Request processed in 113us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.883906:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:2.0:1788833046.906449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.906562:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975488768 00000100:00100000:0.0:1788833046.906574:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975488768 00000100:00100000:0.0:1788833046.906649:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 30 00000100:00100000:0.0:1788833046.906661:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+15:14500:x1875726975488768:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:0.0:1788833046.906692:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833046.906729:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a6095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558ea expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833046.906912:0:15471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788833046.907064:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a6095 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ea expref: 17 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.907081:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0a93b800) 00010000:00010000:0.0:1788833046.907085:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788833046.907091:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a6095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ea expref: 17 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.907141:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036ba600, rc 0) 00000100:00100000:0.0:1788833046.907205:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+16:14500:x1875726975488768:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 547us (770us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788833046.907214:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 30 00000100:00100000:1.0:1788833046.910890:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.911004:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975489024 00000100:00100000:0.0:1788833046.911018:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975489024 00000100:00100000:0.0:1788833046.911075:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:0.0:1788833046.911085:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+16:14500:x1875726975489024:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:0.0:1788833046.911434:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+17:14500:x1875726975489024:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 348us (557us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788833046.911443:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 6 00000100:00100000:1.0:1788833046.950119:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833046.950233:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975489280 00000100:00100000:2.0:1788833046.950245:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975489280 00000100:00100000:2.0:1788833046.950325:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 31 00000100:00100000:2.0:1788833046.950336:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+17:14503:x1875726975489280:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788833046.950366:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833046.950392:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a60a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558f1 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.950524:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a60aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.950541:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a60aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.950554:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a60aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833046.950567:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788833046.950811:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a60a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558f1 expref: 20 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.950834:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a60aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558f1 expref: 19 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833046.950844:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:2.0:1788833046.950847:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833046.950852:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703a00, rc 0) 00000100:00100000:2.0:1788833046.950935:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+19:14503:x1875726975489280:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 600us (829us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788833046.950943:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 31 00000100:00100000:2.0:1788833046.953933:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833046.954032:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833046.954106:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975489536 00000100:00100000:3.0:1788833046.954118:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975489536 00000100:00100000:3.0:1788833046.954210:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00100000:3.0:1788833046.954223:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+19:2357:x1875726975489536:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833046.954241:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833046.954272:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a60aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558f1 expref: 19 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833046.954294:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:3.0:1788833046.954299:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833046.954377:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+18:2357:x1875726975489536:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 157us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833046.954404:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00100000:0.0:1788833046.957873:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975489408 00000100:00100000:0.0:1788833046.957895:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975489408 00000100:00100000:0.0:1788833046.957992:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 32 00000100:00100000:0.0:1788833046.958005:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+18:14503:x1875726975489408:12345-192.168.206.41@tcp:54:lfs.0 00010000:00010000:0.0:1788833046.958096:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a60b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.958118:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a60b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.958133:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a60b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.958168:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a60b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.958197:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a60b8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.958205:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a60b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.958211:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833046.958216:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a60b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.958224:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a60b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.958239:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:0.0:1788833046.958242:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788833046.958248:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a60b8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833046.958254:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba600/0xd270a10c1c6a60b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833046.958406:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+18:14503:x1875726975489408:12345-192.168.206.41@tcp:54:lfs.0 Request processed in 402us (4485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833046.958415:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 32 00000100:00100000:2.0:1788833046.962203:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833046.962296:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975489792 00000100:00100000:0.0:1788833046.962320:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975489792 00000100:00100000:0.0:1788833046.962389:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:0.0:1788833046.962401:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+18:14503:x1875726975489792:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:0.0:1788833046.962727:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+19:14503:x1875726975489792:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 318us (529us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788833046.962772:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 7 00000100:00100000:1.0:1788833047.239654:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833047.239942:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975490048 00000100:00100000:2.0:1788833047.239955:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975490048 00000100:00100000:2.0:1788833047.240222:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 33 00000100:00100000:2.0:1788833047.240236:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+19:14534:x1875726975490048:12345-192.168.206.41@tcp:101:cat.0 00010000:00010000:2.0:1788833047.240415:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833047.240441:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a60bf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558f8 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.240569:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.240586:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.240623:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833047.240637:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788833047.241238:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a60bf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558f8 expref: 22 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.241263:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558f8 expref: 21 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.241272:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:2.0:1788833047.241275:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833047.241279:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703600, rc 0) 00000100:00100000:2.0:1788833047.241687:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+21:14534:x1875726975490048:12345-192.168.206.41@tcp:101:cat.0 Request processed in 1451us (2045us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788833047.241697:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 33 00000100:00100000:1.0:1788833047.245162:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833047.245220:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833047.245328:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975490304 00000100:00100000:0.0:1788833047.245340:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975490304 00000100:00100000:0.0:1788833047.245412:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:0.0:1788833047.245423:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+21:14534:x1875726975490304:12345-192.168.206.41@tcp:35:cat.0 00000100:00100000:0.0:1788833047.246095:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+22:14534:x1875726975490304:12345-192.168.206.41@tcp:35:cat.0 Request processed in 672us (946us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788833047.246105:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 8 00000100:00100000:2.0:1788833047.247694:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975490432 00000100:00100000:2.0:1788833047.247711:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975490432 00000100:00100000:2.0:1788833047.248937:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 1 00000100:00100000:2.0:1788833047.248957:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+22:2357:x1875726975490432:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788833047.248991:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833047.249024:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558f8 expref: 22 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.249049:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:2.0:1788833047.249054:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788833047.249154:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+21:2357:x1875726975490432:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 203us (3932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833047.252174:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 1 00000040:00080000:0.0:1788833047.254725:0:14470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788833047.351847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833047.351986:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975490688 00000100:00100000:3.0:1788833047.352001:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975490688 00000100:00100000:3.0:1788833047.352080:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 34 00000100:00100000:3.0:1788833047.352092:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+21:14540:x1875726975490688:12345-192.168.206.41@tcp:101:dd.0 00010000:00010000:3.0:1788833047.352133:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833047.352159:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a60d4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b558ff expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833047.352299:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a60db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833047.352316:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a60db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833047.352333:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a60db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788833047.352347:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788833047.352555:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3600/0xd270a10c1c6a60d4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ff expref: 24 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833047.352580:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a60db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ff expref: 23 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833047.352590:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:3.0:1788833047.352593:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788833047.352598:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3800, rc 0) 00000100:00100000:3.0:1788833047.352681:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+23:14540:x1875726975490688:12345-192.168.206.41@tcp:101:dd.0 Request processed in 591us (849us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788833047.352690:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 34 00000100:00100000:3.0:1788833047.355855:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833047.355990:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975490944 00000100:00100000:2.0:1788833047.356003:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975490944 00000100:00100000:2.0:1788833047.356079:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 35 00000100:00100000:2.0:1788833047.356091:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+23:14540:x1875726975490944:12345-192.168.206.41@tcp:36:dd.0 00010000:00010000:2.0:1788833047.356169:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788833047.356202:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada3800/0xd270a10c1c6a60db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558ff expref: 23 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.356230:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a608e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558e3 expref: 22 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.356250:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:2.0:1788833047.356256:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833047.356528:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60e9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.356545:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.356556:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788833047.356611:0:14438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788833047.356653:0:14438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f42b34cf reply state 0000000060ad26ec transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833047.356664:0:14438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788833047.356852:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+24:14540:x1875726975490944:12345-192.168.206.41@tcp:36:dd.0 Request processed in 762us (1009us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788833047.356870:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 35 00000020:00080000:2.0:1788833047.356875:0:14438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788833047.361990:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.362012:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60e9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.362021:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60e9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.362029:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703600 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833047.362035:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60e9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.362044:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60e9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.362065:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:0.0:1788833047.362068:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833047.362074:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60e9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.362102:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a60e9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833047.452648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833047.452927:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975491200 00000100:00100000:0.0:1788833047.452942:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975491200 00000100:00100000:0.0:1788833047.453008:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:0.0:1788833047.453022:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+23:14540:x1875726975491200:12345-192.168.206.41@tcp:35:dd.0 00000100:00100000:0.0:1788833047.453571:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+24:14540:x1875726975491200:12345-192.168.206.41@tcp:35:dd.0 Request processed in 549us (933us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1788833047.453583:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 9 00000100:00100000:1.0:1788833047.660295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833047.660477:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975491328 00000100:00100000:0.0:1788833047.660491:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975491328 00000100:00100000:0.0:1788833047.660566:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 36 00000100:00100000:0.0:1788833047.660578:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+24:14554:x1875726975491328:12345-192.168.206.41@tcp:101:stat.0 00010000:00010000:0.0:1788833047.660609:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833047.660634:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a60f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55906 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.660716:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a60f7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.660733:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a60f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.660793:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a60f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.660811:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a60fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.660836:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a60fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.660842:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a60fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.660973:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a6105 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.660983:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a6105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.660993:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a6105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833047.661039:0:15471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788833047.661045:0:15471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833047.661093:0:15471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a6105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661108:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a6105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661118:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a60f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661315:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a60f7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661322:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a60f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661341:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036baa00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833047.661346:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a60f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661354:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a60f7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661369:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984d07e81c00) 00010000:00010000:0.0:1788833047.661372:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833047.661378:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a60f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661384:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a60f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661398:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a60fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661404:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a60fe lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661409:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a60fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661414:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833047.661416:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a60fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661422:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a60fe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661547:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff984d0b543e00) 00010000:00010000:0.0:1788833047.661550:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833047.661553:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a60fe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661560:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a60fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661603:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a60f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55906 expref: 26 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661619:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a6105 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55906 expref: 25 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.661627:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:0.0:1788833047.661630:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833047.661633:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bbe00, rc 0) 00000100:00100000:0.0:1788833047.661832:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+25:14554:x1875726975491328:12345-192.168.206.41@tcp:101:stat.0 Request processed in 1255us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833047.661841:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 36 00000100:00100000:3.0:1788833047.738175:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833047.738684:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975491584 00000100:00100000:2.0:1788833047.738700:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975491584 00000100:00100000:2.0:1788833047.738967:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 37 00000100:00100000:2.0:1788833047.738981:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+25:14560:x1875726975491584:12345-192.168.206.41@tcp:36:truncate.0 00010000:00010000:2.0:1788833047.739052:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833047.739085:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bbe00/0xd270a10c1c6a6105 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55906 expref: 25 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.739109:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:2.0:1788833047.739114:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833047.739589:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a610c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.739607:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a610c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.739618:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a610c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788833047.739921:0:14438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788833047.739953:0:14438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c02082c reply state 00000000109dbcae transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a610c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833047.739976:0:14438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788833047.740160:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+27:14560:x1875726975491584:12345-192.168.206.41@tcp:36:truncate.0 Request processed in 1181us (1999us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788833047.740179:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 37 00000020:00080000:2.0:1788833047.740185:0:14438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788833047.742391:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a610c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.742410:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a610c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.742418:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a610c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.742425:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788833047.742430:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a610c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.742438:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a610c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.742459:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:2.0:1788833047.742462:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833047.742467:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a610c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.742473:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a610c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833047.834553:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833047.978014:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833047.978133:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975491712 00000100:00100000:0.0:1788833047.978146:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975491712 00000100:00100000:0.0:1788833047.978218:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 38 00000100:00100000:0.0:1788833047.978230:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+26:14574:x1875726975491712:12345-192.168.206.41@tcp:101:stat.0 00010000:00010000:0.0:1788833047.978260:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833047.978285:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6113 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5590d expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978396:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a611a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978413:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a611a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978427:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a611a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978443:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6121 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978451:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6121 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978457:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6121 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978564:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6128 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978573:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978579:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833047.978622:0:15471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788833047.978627:0:15471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788833047.978651:0:15471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978676:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978685:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a611a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978691:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a611a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978698:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a611a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978705:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833047.978710:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a611a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978718:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a611a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978731:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984d07e81c00) 00010000:00010000:0.0:1788833047.978734:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833047.978740:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a611a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978789:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba000/0xd270a10c1c6a611a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978804:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6121 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978811:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6121 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978824:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6121 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978830:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036baa00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833047.978833:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6121 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978840:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6121 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978848:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff984d0b543e00) 00010000:00010000:0.0:1788833047.978850:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833047.978864:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6121 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978870:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6121 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978909:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6113 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5590d expref: 28 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978924:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6128 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5590d expref: 27 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833047.978933:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:0.0:1788833047.978934:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833047.978937:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bac00, rc 0) 00000100:00100000:0.0:1788833047.979030:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+27:14574:x1875726975491712:12345-192.168.206.41@tcp:101:stat.0 Request processed in 802us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833047.979047:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 38 00000100:00100000:1.0:1788833048.069840:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833048.070578:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975491968 00000100:00100000:2.0:1788833048.070594:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975491968 00000100:00100000:2.0:1788833048.070741:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 39 00000100:00100000:2.0:1788833048.070915:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+27:14584:x1875726975491968:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788833048.070980:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833048.071007:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a612f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55914 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833048.071133:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788833048.071282:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a612f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55914 expref: 29 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.071297:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0a93b800) 00010000:00010000:2.0:1788833048.071301:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788833048.071318:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a612f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55914 expref: 29 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.071337:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702e00, rc 0) 00000100:00100000:2.0:1788833048.071413:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+28:14584:x1875726975491968:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 505us (1587us total) trans 8589934614 rc 301/301 00000100:00080000:3.0:1788833048.072935:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788833048.073112:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 39 00000100:00100000:1.0:1788833048.074840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833048.075039:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975492224 00000100:00100000:3.0:1788833048.075051:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975492224 00000100:00100000:3.0:1788833048.075131:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00100000:3.0:1788833048.075143:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d398bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+28:14584:x1875726975492224:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:3.0:1788833048.075453:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d398bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+29:14584:x1875726975492224:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 311us (622us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788833048.075462:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00100000:1.0:1788833048.147257:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833048.147486:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975492480 00000100:00100000:0.0:1788833048.147499:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975492480 00000100:00100000:0.0:1788833048.147569:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 40 00000100:00100000:0.0:1788833048.147580:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d39f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+29:14590:x1875726975492480:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:0.0:1788833048.147610:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833048.147634:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a613d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5591b expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.147807:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.147824:0:15471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a6079 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558dc expref: 30 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.147834:0:15471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6128 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5590d expref: 30 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.147842:0:15471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.147895:0:15471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6128 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5590d expref: 30 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.147910:0:15471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6128 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5590d expref: 30 pid: 15471 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.147925:0:15471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15471:1875726994350848:192.168.206.41@tcp:104: 00010000:00010000:0.0:1788833048.148073:0:15471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a6079 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558dc expref: 30 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.148083:0:15471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a6079 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558dc expref: 30 pid: 14439 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.148093:0:15471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15471:1875726994350976:192.168.206.41@tcp:104: 00000100:00100000:0.0:1788833048.148542:0:15471:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3b1d6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788833048.152330:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.152378:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833048.152514:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975492608 00000100:00100000:3.0:1788833048.152526:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975492608 00010000:00010000:3.0:1788833048.152575:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6128 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5590d expref: 31 pid: 15471 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833048.152623:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975492736 00000100:00100000:3.0:1788833048.152627:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975492736 00010000:00010000:3.0:1788833048.152639:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a6079 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558dc expref: 32 pid: 14439 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833048.152655:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:3.0:1788833048.152664:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3fa91c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+32:2358:x1875726975492608:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833048.152681:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833048.152705:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6128 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5590d expref: 32 pid: 15471 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.152720:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6128 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5590d expref: 32 pid: 15471 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.152795:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:3.0:1788833048.152802:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.152813:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.152820:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833048.152896:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3fa91c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+32:2358:x1875726975492608:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 232us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833048.152905:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:3.0:1788833048.152970:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:3.0:1788833048.152978:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+31:2358:x1875726975492736:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833048.152985:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833048.152990:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a6079 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558dc expref: 31 pid: 14439 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.153000:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a6079 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558dc expref: 31 pid: 14439 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.153011:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:3.0:1788833048.153015:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.153030:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.153039:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.153059:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833048.153079:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+31:2358:x1875726975492736:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 102us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833048.153086:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 12 00010000:00010000:0.0:1788833048.153887:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6128 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5590d expref: 30 pid: 15471 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.153912:0:15471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15471:1875726994350848:192.168.206.41@tcp:104: 00010000:00010000:0.0:1788833048.153926:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3ada2400/0xd270a10c1c6a6079 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b558dc expref: 29 pid: 14439 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.153939:0:15471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15471:1875726994350976:192.168.206.41@tcp:104: 00010000:00010000:0.0:1788833048.153968:0:15471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.153979:0:15471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.153985:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833048.154007:0:15471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788833048.154217:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a613d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5591b expref: 30 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.154251:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5591b expref: 29 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.154260:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:0.0:1788833048.154263:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788833048.154266:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036baa00, rc 0) 00000100:00100000:0.0:1788833048.154326:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d39f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+29:14590:x1875726975492480:12345-192.168.206.41@tcp:101:bash.0 Request processed in 6748us (7084us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788833048.154336:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 40 00000100:00100000:1.0:1788833048.158039:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833048.158154:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975492992 00000100:00100000:2.0:1788833048.158166:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975492992 00000100:00100000:2.0:1788833048.158233:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 41 00000100:00100000:2.0:1788833048.158245:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+29:14590:x1875726975492992:12345-192.168.206.41@tcp:36:bash.0 00010000:00010000:2.0:1788833048.158587:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6152 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.158606:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6152 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.158619:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6152 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788833048.158688:0:14438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788833048.158714:0:14438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e7667bb reply state 00000000968c6213 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6152 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833048.158725:0:14438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788833048.158874:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+32:14590:x1875726975492992:12345-192.168.206.41@tcp:36:bash.0 Request processed in 630us (849us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788833048.158882:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 41 00000020:00080000:2.0:1788833048.158887:0:14438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788833048.161722:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00010000:00010000:0.0:1788833048.161868:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6152 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.161883:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6152 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.161891:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6152 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.161898:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702e00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833048.161903:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6152 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.161911:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6152 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.161931:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:0.0:1788833048.161934:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833048.161940:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6152 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.161962:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6152 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833048.162088:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975493120 00000100:00100000:1.0:1788833048.162101:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975493120 00000100:00100000:1.0:1788833048.162172:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 42 00000100:00100000:1.0:1788833048.162184:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+31:14590:x1875726975493120:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:1.0:1788833048.162211:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833048.162231:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a6159 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55922 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.162303:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a6159 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55922 expref: 32 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.162330:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a6159 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55922 expref: 32 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.162351:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:1.0:1788833048.162354:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788833048.162357:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f05200, rc 0) 00000100:00100000:1.0:1788833048.162426:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+32:14590:x1875726975493120:12345-192.168.206.41@tcp:101:bash.0 Request processed in 244us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833048.162434:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 42 00000100:00100000:3.0:1788833048.168641:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833048.168818:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975493248 00000100:00100000:2.0:1788833048.168832:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975493248 00000100:00100000:2.0:1788833048.168915:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 43 00000100:00100000:2.0:1788833048.168928:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+32:14590:x1875726975493248:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:2.0:1788833048.168956:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833048.168982:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6160 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55929 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.169090:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a6167 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.169106:0:14438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5591b expref: 33 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.169116:0:14438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a6167 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.169167:0:14438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5591b expref: 33 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.169204:0:14438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5591b expref: 33 pid: 15471 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833048.169222:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1875726994351104:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788833048.169341:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d06d77a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788833048.172050:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833048.172291:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975493376 00000100:00100000:0.0:1788833048.172303:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975493376 00010000:00010000:0.0:1788833048.172351:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5591b expref: 34 pid: 15471 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.172400:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00100000:0.0:1788833048.172412:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+34:2358:x1875726975493376:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833048.172431:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833048.172440:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5591b expref: 34 pid: 15471 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.172455:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5591b expref: 34 pid: 15471 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.172485:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:0.0:1788833048.172492:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a6167 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.172503:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a6167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.172512:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a6167 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.172535:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833048.172612:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+34:2358:x1875726975493376:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 201us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833048.172620:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 13 00010000:00010000:2.0:1788833048.174095:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036baa00/0xd270a10c1c6a6144 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5591b expref: 33 pid: 15471 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833048.174248:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1875726994351104:192.168.206.41@tcp:104: 00010000:00010000:2.0:1788833048.174276:0:14438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a6167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.174287:0:14438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a6167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.174472:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a6167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833048.174538:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788833048.174543:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833048.174564:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a6167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.174608:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6160 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55929 expref: 33 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.174632:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a6167 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55929 expref: 32 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.174659:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:2.0:1788833048.174662:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788833048.174665:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703c00, rc 0) 00000100:00100000:2.0:1788833048.174821:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+32:14590:x1875726975493248:12345-192.168.206.41@tcp:101:bash.0 Request processed in 5894us (6195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833048.174830:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 43 00000100:00100000:3.0:1788833048.177494:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.177789:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975493632 00000100:00100000:1.0:1788833048.177804:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975493632 00000100:00100000:1.0:1788833048.177882:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 2 00000100:00100000:1.0:1788833048.177897:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+32:14590:x1875726975493632:12345-192.168.206.41@tcp:103:bash.0 00010000:00010000:1.0:1788833048.177913:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788833048.177937:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a6167 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55929 expref: 32 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.177960:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a6159 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55922 expref: 31 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.177969:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d07e81a00) 00010000:00010000:1.0:1788833048.177987:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833048.178057:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+30:14590:x1875726975493632:12345-192.168.206.41@tcp:103:bash.0 Request processed in 165us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833048.178065:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 2 00000100:00100000:3.0:1788833048.183712:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.183835:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975493760 00000100:00100000:1.0:1788833048.183844:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975493760 00000100:00100000:1.0:1788833048.183952:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 44 00000100:00100000:1.0:1788833048.183963:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+30:14590:x1875726975493760:12345-192.168.206.41@tcp:58:bash.0 00010000:00010000:1.0:1788833048.184065:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a616e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.184080:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a616e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.184092:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a616e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788833048.186493:0:14439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788833048.190124:0:14439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788833048.190215:0:14439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788833048.190357:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+30:14590:x1875726975493760:12345-192.168.206.41@tcp:58:bash.0 Request processed in 6390us (6647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833048.190369:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 44 00000100:00100000:2.0:1788833048.201684:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.202884:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975493888 00000100:00100000:1.0:1788833048.202895:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975493888 00000100:00100000:1.0:1788833048.202960:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 45 00000100:00100000:1.0:1788833048.202971:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+30:14590:x1875726975493888:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:1.0:1788833048.202990:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833048.203941:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a6175 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55930 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.204066:0:14437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a616e lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.204080:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a6175 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55930 expref: 31 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.204161:0:14437:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a616e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.204177:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a6175 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55930 expref: 31 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.204191:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d0a93be00) 00010000:00010000:1.0:1788833048.204206:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788833048.204212:0:14437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a6175 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55930 expref: 31 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.204219:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04600, rc 0) 00000100:00100000:1.0:1788833048.204337:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+31:14590:x1875726975493888:12345-192.168.206.41@tcp:101:bash.0 Request processed in 1367us (2661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833048.204345:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 45 00000040:00080000:0.0:1788833048.278385:0:14470:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788833048.278394:0:14470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788833048.278429:0:14470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788833048.278436:0:14470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788833048.278553:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14470:1875726994351232:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788833048.278661:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3b1d60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833048.280721:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14470:1875726994351232:192.168.206.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788833048.290839:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.291057:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975494016 00000100:00100000:1.0:1788833048.291065:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975494016 00000100:00100000:1.0:1788833048.291105:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00100000:1.0:1788833048.291123:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+31:14591:x1875726975494016:12345-192.168.206.41@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788833048.291193:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+31:14591:x1875726975494016:12345-192.168.206.41@tcp:900:lhsmtool_posix.0 Request processed in 79us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833048.291200:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 0 00000100:00100000:2.0:1788833048.295583:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833048.295728:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975494144 00000100:00100000:0.0:1788833048.295777:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975494144 00000100:00100000:0.0:1788833048.295836:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 46 00000100:00100000:0.0:1788833048.295846:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+31:14591:x1875726975494144:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788833048.295887:0:15471:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788833048.296012:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+31:14591:x1875726975494144:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 Request processed in 166us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833048.296019:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 46 00000100:00100000:3.0:1788833048.312028:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.312136:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975494272 00000100:00100000:1.0:1788833048.312151:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975494272 00000100:00100000:1.0:1788833048.312226:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 47 00000100:00100000:1.0:1788833048.312238:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+31:14591:x1875726975494272:12345-192.168.206.41@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788833048.312307:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a617c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312323:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a617c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312336:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a617c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312370:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a6183 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312378:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a6183 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312385:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a6183 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312408:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a618a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312416:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a618a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312422:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a618a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788833048.312462:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788833048.312466:0:14437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788833048.312482:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a618a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312492:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a617c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312498:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a617c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312504:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a617c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312518:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788833048.312522:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a617c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312529:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a617c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312540:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d0b543700) 00010000:00010000:1.0:1788833048.312543:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833048.312547:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a617c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312552:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a617c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312565:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a6183 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312571:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a6183 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312576:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a6183 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312581:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788833048.312583:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a6183 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312588:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a6183 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312606:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff984d0a93b900) 00010000:00010000:1.0:1788833048.312608:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833048.312611:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a6183 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312617:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a6183 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312631:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a618a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312637:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a618a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312642:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a618a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312646:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788833048.312648:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a618a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312654:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a618a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312661:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d0a93be00) 00010000:00010000:1.0:1788833048.312663:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788833048.312666:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a618a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.312671:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a618a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833048.312838:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+31:14591:x1875726975494272:12345-192.168.206.41@tcp:34:lhsmtool_posix.0 Request processed in 599us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833048.312847:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 47 00000100:00100000:3.0:1788833048.324308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833048.324448:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975494528 00000100:00100000:0.0:1788833048.324463:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975494528 00000100:00100000:0.0:1788833048.324554:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 48 00000100:00100000:0.0:1788833048.324575:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+31:14591:x1875726975494528:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833048.324604:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833048.324632:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6191 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55937 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.324840:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6198 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.324869:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6198 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.324885:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6198 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788833048.324898:0:15471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788833048.325033:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6198 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.325042:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6198 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.325049:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6198 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.325056:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036bac00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833048.325062:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6198 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.325071:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6198 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.325088:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d0a93be00) 00010000:00010000:0.0:1788833048.325091:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788833048.325098:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6198 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.325115:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a6198 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.325169:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6191 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55937 expref: 33 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.325181:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff984d0b543700) 00010000:00010000:0.0:1788833048.325183:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788833048.325187:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a6191 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55937 expref: 33 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.325198:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bb800, rc 0) 00000100:00100000:0.0:1788833048.325286:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+32:14591:x1875726975494528:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 713us (992us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1788833048.325294:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 48 00000100:00100000:3.0:1788833048.341196:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.341321:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975494656 00000100:00100000:1.0:1788833048.341334:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975494656 00000100:00100000:1.0:1788833048.341406:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 49 00000100:00100000:1.0:1788833048.341419:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+32:14591:x1875726975494656:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788833048.341537:0:14437:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788833048.341885:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+32:14591:x1875726975494656:12345-192.168.206.41@tcp:53:lhsmtool_posix.0 Request processed in 468us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833048.341895:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 49 00000100:00100000:3.0:1788833048.353102:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833048.353213:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975494912 00000100:00100000:0.0:1788833048.353228:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975494912 00000100:00100000:0.0:1788833048.353310:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 50 00000100:00100000:0.0:1788833048.353323:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+32:14591:x1875726975494912:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833048.353349:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833048.353374:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a61a6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5593e expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788833048.355903:0:15471:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:0.0:1788833048.355918:0:15471:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788833048.356012:0:15471:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788833048.356412:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a61ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.356444:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a61ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.356459:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a61ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.356548:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bb800/0xd270a10c1c6a61a6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5593e expref: 35 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.357113:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a61ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5593e expref: 34 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.357128:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984d0b543e00) 00010000:00010000:0.0:1788833048.357131:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788833048.357136:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036bac00, rc 0) 00000100:00100000:0.0:1788833048.357261:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+34:14591:x1875726975494912:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 3939us (4173us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788833048.357272:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 50 00000100:00100000:3.0:1788833048.363556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833048.363677:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975495168 00000100:00100000:2.0:1788833048.363701:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975495168 00000100:00100000:2.0:1788833048.363803:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 51 00000100:00100000:2.0:1788833048.363813:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+34:14591:x1875726975495168:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788833048.363883:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833048.363909:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036bac00/0xd270a10c1c6a61ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5593e expref: 34 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.363933:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984d0b543e00) 00010000:00010000:2.0:1788833048.363947:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833048.363970:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61bb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.363984:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.363998:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364087:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a61c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x53d89351 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364096:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a61c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53d89351 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364106:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a61c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53d89351 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364167:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364174:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61bb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364181:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61bb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364186:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788833048.364190:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61bb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364198:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61bb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364207:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984d07e81c00) 00010000:00010000:2.0:1788833048.364210:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833048.364213:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61bb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364220:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61bb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364251:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a61c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53d89351 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364257:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a61c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53d89351 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364262:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a61c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53d89351 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364267:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788833048.364270:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a61c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53d89351 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364275:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a61c2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x53d89351 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364283:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x53d89351 (ffff984d06f05400) 00010000:00010000:2.0:1788833048.364286:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833048.364289:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a61c2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x53d89351 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.364293:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a61c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x53d89351 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833048.364381:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+33:14591:x1875726975495168:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 568us (840us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788833048.364389:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 51 00000100:00100000:3.0:1788833048.370053:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.371642:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975495296 00000100:00100000:1.0:1788833048.371661:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975495296 00000100:00100000:1.0:1788833048.371807:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 52 00000100:00100000:1.0:1788833048.371821:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ace7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+33:14591:x1875726975495296:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788833048.371867:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788833048.372138:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a61c9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55945 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.372198:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a61d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.372219:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a61d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.372235:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a61d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.372373:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05800/0xd270a10c1c6a61c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55945 expref: 35 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.372397:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04c00/0xd270a10c1c6a61d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55945 expref: 34 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.372407:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984d0a93b900) 00010000:00010000:1.0:1788833048.372411:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788833048.372414:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d05f04c00, rc 0) 00000100:00100000:1.0:1788833048.373399:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ace7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+34:14591:x1875726975495296:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 1572us (3656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833048.373411:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 52 00000100:00100000:3.0:1788833048.377286:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.377503:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975495552 00000100:00100000:1.0:1788833048.377517:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975495552 00000100:00100000:1.0:1788833048.377911:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 53 00000100:00100000:1.0:1788833048.377924:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+34:14591:x1875726975495552:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788833048.378038:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a61d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.378060:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a61d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.378077:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a61d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788833048.378599:0:14437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1788833048.378614:0:14437:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 552068869360ns, next at 553068866461ns, rc = 0 00000004:00010000:1.0:1788833048.380733:0:14437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d044301 reply state 00000000494bbb9d transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a61d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833048.381180:0:14437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788833048.383059:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+36:14591:x1875726975495552:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 5124us (5775us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1788833048.383075:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 53 00010000:00010000:2.0:1788833048.386277:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a61d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.386315:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a61d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.386323:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a61d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.386328:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788833048.386333:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a61d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.386340:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a61d7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.386357:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984d0a93b900) 00010000:00010000:2.0:1788833048.386360:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788833048.386365:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a61d7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.386371:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a61d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.397045:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833048.397167:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975495680 00000100:00100000:2.0:1788833048.397182:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975495680 00000100:00100000:2.0:1788833048.397243:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 54 00000100:00100000:2.0:1788833048.397254:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+35:14591:x1875726975495680:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788833048.397276:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833048.397298:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5594c expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.397379:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5594c expref: 36 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.397396:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5594c expref: 36 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.397415:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984d0a93b900) 00010000:00010000:2.0:1788833048.397419:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788833048.397422:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703c00, rc 0) 00000100:00100000:2.0:1788833048.397488:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+36:14591:x1875726975495680:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 236us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833048.397495:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 54 00000100:00100000:3.0:1788833048.405128:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.405301:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975495808 00000100:00100000:1.0:1788833048.405319:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975495808 00000100:00100000:1.0:1788833048.405414:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00100000:1.0:1788833048.405427:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+5:2357:x1875726975495808:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788833048.406123:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:2357:x1875726975495808:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 Request processed in 688us (1009us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788833048.406135:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 10 00000100:00080000:3.0:1788833048.406198:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788833048.410545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833048.410781:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975496064 00000100:00100000:2.0:1788833048.410799:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975496064 00000100:00100000:2.0:1788833048.410935:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:2.0:1788833048.410947:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+36:14591:x1875726975496064:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788833048.411236:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+37:14591:x1875726975496064:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 290us (709us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788833048.411244:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:1.0:1788833048.418447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833048.420519:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975496320 00000100:00100000:2.0:1788833048.420533:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975496320 00000100:00100000:2.0:1788833048.420624:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 55 00000100:00100000:2.0:1788833048.420889:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+37:14591:x1875726975496320:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788833048.421008:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+37:14591:x1875726975496320:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 122us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833048.421343:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 55 00000100:00100000:3.0:1788833048.437957:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833048.438099:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975496448 00000100:00100000:2.0:1788833048.438109:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975496448 00000100:00100000:2.0:1788833048.438167:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 56 00000100:00100000:2.0:1788833048.438176:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3a9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+37:14591:x1875726975496448:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788833048.438195:0:15471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833048.438214:0:15471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a61e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55953 expref: -99 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.438280:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a61ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.438293:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a61ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.438304:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a61ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833048.438337:0:15471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788833048.438354:0:15471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a61ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.438378:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a61e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55953 expref: 39 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.438396:0:15471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a61ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55953 expref: 38 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.438416:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984d0a93b900) 00010000:00010000:2.0:1788833048.438419:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788833048.438422:0:15471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703600, rc 0) 00000100:00100000:2.0:1788833048.438473:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3a9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+38:14591:x1875726975496448:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 298us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833048.438479:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 56 00000100:00100000:3.0:1788833048.441586:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833048.441777:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975496576 00000100:00100000:0.0:1788833048.441786:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975496576 00000100:00100000:0.0:1788833048.441836:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:0.0:1788833048.441845:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+6:2358:x1875726975496576:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788833048.441873:0:15123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788833048.441892:0:15123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a61f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5595a expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788833048.441930:0:15123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f6d18, blocks: 0x1 00010000:00010000:0.0:1788833048.441949:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1788833048.441954:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833048.441963:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a61f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5595a expref: 7 pid: 15123 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.441983:0:15123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a61f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5595a expref: 7 pid: 15123 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.441997:0:15123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d036ba000, rc 0) 00000100:00100000:0.0:1788833048.442057:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+7:2358:x1875726975496576:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 212us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833048.442064:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 11 00000100:00100000:0.0:1788833048.446788:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.446950:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975496832 00000100:00100000:1.0:1788833048.446960:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975496832 00000100:00100000:1.0:1788833048.447019:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 57 00000100:00100000:1.0:1788833048.447029:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+38:14591:x1875726975496832:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788833048.447150:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+38:14591:x1875726975496832:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 122us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833048.447166:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 57 00000100:00100000:3.0:1788833048.454044:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833048.454268:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975496960 00000100:00100000:2.0:1788833048.454282:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975496960 00000100:00100000:2.0:1788833048.454373:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 58 00000100:00100000:2.0:1788833048.454387:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+38:14591:x1875726975496960:12345-192.168.206.41@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788833048.524138:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+38:14591:x1875726975496960:12345-192.168.206.41@tcp:44:lhsmtool_posix.0 Request processed in 69733us (70087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833048.524155:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 58 00000001:00080000:2.0:1788833048.525974:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:2.0:1788833048.526023:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:2.0:1788833048.526040:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:2.0:1788833048.526046:0:5875:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788833048.526073:0:5875:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:1.0:1788833048.527548:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788833048.528324:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833048.528458:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975497088 00000100:00100000:0.0:1788833048.528468:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975497088 00000100:00100000:0.0:1788833048.528530:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:0.0:1788833048.528548:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+7:2358:x1875726975497088:12345-192.168.206.41@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788833048.528683:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+7:2358:x1875726975497088:12345-192.168.206.41@tcp:16:lhsmtool_posix.0 Request processed in 143us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833048.528698:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:0.0:1788833048.532788:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833048.532987:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975497344 00000100:00100000:2.0:1788833048.532998:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975497344 00000100:00100000:2.0:1788833048.533065:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 59 00000100:00100000:2.0:1788833048.533075:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+13:14591:x1875726975497344:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788833048.533146:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788833048.533177:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703600/0xd270a10c1c6a61ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55953 expref: 13 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.533199:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984d0a93b900) 00010000:00010000:2.0:1788833048.533220:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788833048.533263:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a61fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.533279:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a61fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.533291:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a61fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833048.534196:0:14437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7548a37 reply state 00000000e7e0f8eb transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a61fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833048.534213:0:14437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788833048.534346:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+14:14591:x1875726975497344:12345-192.168.206.41@tcp:36:lhsmtool_posix.0 Request processed in 1270us (1612us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788833048.534355:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 59 00000100:00100000:0.0:1788833048.536955:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994351360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788833048.537053:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788833048.541708:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994351360 00000100:00100000:3.0:1788833048.541722:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994351360 00000100:00100000:3.0:1788833048.541837:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788833048.541849:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994351360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788833048.542099:0:15124:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788833048.542103:0:15124:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788833048.542106:0:15124:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788833048.542108:0:15124:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788833048 -> 1788833048 00002000:00010000:3.0:1788833048.542111:0:15124:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788833048.542225:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875726994351360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 378us (5171us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788833048.542244:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:3.0:1788833048.542308:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff984d3b7d4700/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788833048.542316:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994351360:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788833048.543183:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788833048.543543:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a61fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.543560:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a61fa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.543568:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a61fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.543575:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833048.543581:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a61fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.543589:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a61fa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.543661:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984d0a93b900) 00010000:00010000:0.0:1788833048.543665:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833048.543671:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a61fa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.543678:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a61fa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.544603:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833048.545419:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975497472 00000100:00100000:3.0:1788833048.545435:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975497472 00000100:00100000:3.0:1788833048.545518:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:3.0:1788833048.545529:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+7:14591:x1875726975497472:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788833048.545553:0:15123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788833048.545939:0:15123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a6201 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55961 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.545981:0:15123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a61f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5595a expref: 8 pid: 15123 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.545992:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833048.546013:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788833048.546020:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a6201 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55961 expref: 8 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.546064:0:15123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a61f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5595a expref: 8 pid: 15123 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.546080:0:15123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a61f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5595a expref: 8 pid: 15123 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833048.546099:0:15123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15123:1875726994351488:192.168.206.41@tcp:104: 00000100:00100000:3.0:1788833048.546218:0:15123:0:(client.c:2715:ptlrpc_set_wait()) set ffff984c07b8c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788833048.552189:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833048.552274:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975497600 00000100:00100000:0.0:1788833048.552287:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975497600 00010000:00010000:0.0:1788833048.552350:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a61f3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5595a expref: 9 pid: 15123 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.552413:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:0.0:1788833048.552443:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:2357:x1875726975497600:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833048.552464:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833048.552504:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a61f3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5595a expref: 9 pid: 15123 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.552521:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a61f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5595a expref: 9 pid: 15123 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.552554:0:14423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833048.552570:0:14423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788833048.552579:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a6201 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55961 expref: 9 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.552591:0:14423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a6201 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55961 expref: 9 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.552639:0:14423:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a6201 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55961 expref: 9 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.552656:0:14423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14423:1875726994351616:192.168.206.41@tcp:105: 00000100:00100000:0.0:1788833048.552838:0:14423:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d3b1d60c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788833048.553964:0:15123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076d0c4f2/0xd270a10c1c6a61f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5595a expref: 9 pid: 15123 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833048.553989:0:15123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b37f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15123:1875726994351488:192.168.206.41@tcp:104: 00010000:00010000:3.0:1788833048.554022:0:15123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a6201 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55961 expref: 8 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.554038:0:15123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3ada3600, rc 0) 00000100:00100000:3.0:1788833048.554108:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+8:14591:x1875726975497472:12345-192.168.206.41@tcp:101:lhsmtool_posix.0 Request processed in 8580us (9514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833048.554128:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:2.0:1788833048.560518:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.560677:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975497728 00000100:00100000:1.0:1788833048.560689:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975497728 00000100:00100000:1.0:1788833048.560793:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:1.0:1788833048.560804:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+8:2358:x1875726975497728:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788833048.561101:0:14423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14423:1875726994351616:192.168.206.41@tcp:105: 00002000:00010000:1.0:1788833048.561102:0:15121:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788833048.561108:0:15121:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788833048 00002000:00010000:1.0:1788833048.561112:0:15121:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788833047 00002000:00010000:1.0:1788833048.561114:0:15121:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788833048 -> 1788833048 00002000:00010000:1.0:1788833048.561117:0:15121:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:0.0:1788833048.561147:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788833048.561198:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:2358:x1875726975497728:12345-192.168.206.41@tcp:2:lhsmtool_posix.0 Request processed in 394us (692us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788833048.561199:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:2357:x1875726975497600:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 8757us (9022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788833048.561215:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:0.0:1788833048.561238:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:2.0:1788833048.566497:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833048.566716:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975497856 00000100:00100000:3.0:1788833048.566731:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975497856 00000100:00100000:2.0:1788833048.567172:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:2.0:1788833048.567184:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+8:2358:x1875726975497856:12345-192.168.206.41@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788833048.567443:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.567471:0:15123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a6201 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55961 expref: 8 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.567494:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833048.567506:0:15123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788833048.567512:0:15123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.567682:0:15123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a6201 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55961 expref: 8 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.567711:0:15123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a6201 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55961 expref: 8 pid: 15123 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833048.567730:0:15123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3ac84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15123:1875726994351744:192.168.206.41@tcp:104: 00000100:00100000:2.0:1788833048.568039:0:15123:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d10db2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788833048.571594:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833048.571906:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975497984 00000100:00100000:3.0:1788833048.571918:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975497984 00010000:00010000:3.0:1788833048.571973:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a6201 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55961 expref: 9 pid: 15123 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833048.572029:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:3.0:1788833048.572041:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:2357:x1875726975497984:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788833048.572065:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788833048.572096:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a6201 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55961 expref: 9 pid: 15123 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.572123:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a6201 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55961 expref: 9 pid: 15123 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.572153:0:14424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788833048.572158:0:14424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788833048.572165:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.572176:0:14424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788833048.572202:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788833048.572281:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+9:2357:x1875726975497984:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 241us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788833048.572290:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 15 00010000:00010000:0.0:1788833048.575814:0:15123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d443ed6/0xd270a10c1c6a6201 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55961 expref: 8 pid: 15123 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.575848:0:15123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3ac84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15123:1875726994351744:192.168.206.41@tcp:104: 00010000:00010000:0.0:1788833048.575893:0:15123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.575908:0:15123:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.575915:0:15123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.576042:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.576052:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.576061:0:15123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.576069:0:15123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b702800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:0.0:1788833048.576074:0:15123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.576107:0:15123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.576131:0:15123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.576140:0:15123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041f654e3/0xd270a10c1c6a6208 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.576256:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+7:2358:x1875726975497856:12345-192.168.206.41@tcp:1:lhsmtool_posix.0 Request processed in 9074us (9783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833048.576267:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:2.0:1788833048.579218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.579335:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975498240 00000100:00100000:1.0:1788833048.579347:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975498240 00000100:00100000:1.0:1788833048.579430:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 60 00000100:00100000:1.0:1788833048.579442:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+13:14591:x1875726975498240:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788833048.579553:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a620f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.579575:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a620f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.579590:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a620f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.580005:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.580021:0:14439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61de lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5594c expref: 14 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.580031:0:14439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.580081:0:14439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5594c expref: 14 pid: 15471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.580096:0:14439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61de lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5594c expref: 14 pid: 15471 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833048.580113:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1875726994351872:192.168.206.41@tcp:104: 00000100:00100000:1.0:1788833048.580224:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d031faa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788833048.585937:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1875726994351872:192.168.206.41@tcp:104: 00010000:00010000:1.0:1788833048.585986:0:14439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833048.587539:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833048.587640:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975498368 00000100:00100000:0.0:1788833048.587650:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975498368 00010000:00010000:0.0:1788833048.587695:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61de lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5594c expref: 15 pid: 15471 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.587738:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 16 00000100:00100000:0.0:1788833048.587789:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+15:2358:x1875726975498368:12345-192.168.206.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788833048.587807:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788833048.587814:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61de lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5594c expref: 15 pid: 15471 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.587829:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5594c expref: 15 pid: 15471 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.587886:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a61de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5594c expref: 15 pid: 15471 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.587906:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984d0a93b900) 00010000:00010000:0.0:1788833048.587912:0:14423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.587923:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.587931:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.587956:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788833048.588027:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+14:2358:x1875726975498368:12345-192.168.206.41@tcp:103:ldlm_bl.0 Request processed in 240us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833048.588036:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 16 00010000:00010000:1.0:1788833048.588162:0:14439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.588171:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788833048.588445:0:14439:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1788833048.588614:0:14439:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1788833048.588663:0:14439:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1788833048.588821:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14439:1875726994352000:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788833048.598525:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833048.598582:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d031fa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788833048.600118:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994352000 00000100:00100000:0.0:1788833048.600134:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994352000 00000100:00100000:0.0:1788833048.600196:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788833048.600212:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14439:x1875726994352000:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788833048.600469:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14439:x1875726994352000:12345-0@lo:1000:mdt00_002.0 Request processed in 263us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833048.600477:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788833048.600871:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14439:1875726994352000:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788833048.602849:0:14439:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1788833048.602950:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d0647bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14439:1875726994352128:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788833048.603018:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788833048.603047:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d031faa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788833048.606812:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994352128 00000100:00100000:0.0:1788833048.606828:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994352128 00000100:00100000:0.0:1788833048.606894:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788833048.606907:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14439:x1875726994352128:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788833048.607175:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14439:x1875726994352128:12345-0@lo:1000:mdt00_002.0 Request processed in 271us (4156us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788833048.607183:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788833048.610253:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d0647bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14439:1875726994352128:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788833048.610304:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610315:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610322:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610328:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788833048.610333:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610340:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610356:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984d0a93b900) 00010000:00010000:1.0:1788833048.610359:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788833048.610363:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610369:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05a00/0xd270a10c1c6a6216 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610403:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a616e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610411:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a616e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610431:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a616e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610436:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f05200 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:1.0:1788833048.610439:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a616e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610445:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a616e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610453:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d0a93be00) 00010000:00010000:1.0:1788833048.610455:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788833048.610462:0:14439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a6175 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55930 expref: 17 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610474:0:14439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a6175 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55930 expref: 17 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610482:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a6175 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55930 expref: 17 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.610540:0:14439:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04600/0xd270a10c1c6a6175 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55930 expref: 17 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788833048.610553:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d06478e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1875726994352256:192.168.206.41@tcp:105: 00000100:00100000:1.0:1788833048.610650:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff984d031faf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788833048.617463:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833048.617557:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975498496 00000100:00100000:0.0:1788833048.617573:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975498496 00000100:00100000:0.0:1788833048.617654:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:0.0:1788833048.617665:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3ac85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+18:14590:x1875726975498496:12345-192.168.206.41@tcp:49:bash.0 00000100:00100000:0.0:1788833048.617862:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+18:14590:x1875726975498496:12345-192.168.206.41@tcp:49:bash.0 Request processed in 187us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833048.617870:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 12 00000100:00100000:3.0:1788833048.630041:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:1.0:1788833048.631256:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d06478e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1875726994352256:192.168.206.41@tcp:105: 00010000:00010000:1.0:1788833048.631419:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a616e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788833048.631433:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f05200/0xd270a10c1c6a616e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833048.631633:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975498624 00000100:00100000:2.0:1788833048.631642:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975498624 00000100:00100000:2.0:1788833048.631710:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 17 00000100:00100000:2.0:1788833048.631721:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b37f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+7:14590:x1875726975498624:12345-192.168.206.41@tcp:101:bash.0 00010000:00010000:2.0:1788833048.631764:0:15121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833048.631793:0:15121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a621d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b55968 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788833048.631826:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f6d18, atime: 0x6a9f6d17, ctime: 0x6a9f6d18, blocks: 0x1 00010000:00010000:2.0:1788833048.631863:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=552s v=(0 0) 00010000:00010000:2.0:1788833048.631875:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788833048.631886:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a621d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55968 expref: 8 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.631910:0:15121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000918b3a83/0xd270a10c1c6a621d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b55968 expref: 8 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.631924:0:15121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b703600, rc 0) 00000100:00100000:2.0:1788833048.632003:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b37f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+8:14590:x1875726975498624:12345-192.168.206.41@tcp:101:bash.0 Request processed in 282us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833048.632011:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 17 00000100:00100000:1.0:1788833048.635494:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00010000:00010000:0.0:1788833048.636059:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a6224 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636092:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a6224 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636108:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a6224 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636126:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a6224 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636132:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a6224 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636140:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a6224 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636147:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba800 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833048.636153:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a6224 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636180:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a6224 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636196:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d0a93be00) 00010000:00010000:0.0:1788833048.636199:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788833048.636205:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a6224 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636212:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a6224 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788833048.636327:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975498880 00000100:00100000:3.0:1788833048.636340:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975498880 00000100:00100000:3.0:1788833048.636428:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 13 00000100:00100000:3.0:1788833048.636439:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+18:14590:x1875726975498880:12345-192.168.206.41@tcp:35:bash.0 00010000:00010000:0.0:1788833048.636488:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a620f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636497:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a620f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636504:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a620f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636510:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d05f04000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:0.0:1788833048.636513:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a620f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636520:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a620f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636539:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d0a93be00) 00010000:00010000:0.0:1788833048.636543:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788833048.636546:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a620f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.636566:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d05f04000/0xd270a10c1c6a620f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.637135:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3ac84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e168a9c-e2a0-4132-9a92-188a53d61a6f+19:14591:x1875726975498240:12345-192.168.206.41@tcp:57:lhsmtool_posix.0 Request processed in 57691us (57926us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788833048.637146:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 60 00000020:00080000:0.0:1788833048.637153:0:14439:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788833048.637264:0:14470:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788833048.637272:0:14470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788833048.637299:0:14470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788833048.637308:0:14470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:3.0:1788833048.637634:0:14441:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000001:00080000:3.0:1788833048.638335:0:14441:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:3.0:1788833048.638891:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+20:14590:x1875726975498880:12345-192.168.206.41@tcp:35:bash.0 Request processed in 2092us (3043us total) trans 8589934631 rc 0/0 00000100:00100000:3.0:1788833048.638905:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 13 00000020:00080000:3.0:1788833048.638912:0:14441:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788833048.646430:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:0.0:1788833048.646545:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975499136 00000100:00100000:0.0:1788833048.646556:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975499136 00000100:00100000:0.0:1788833048.646614:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 14 00000100:00100000:0.0:1788833048.646624:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d0647aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+20:14591:x1875726975499136:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788833048.647337:0:14440:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788833048.647440:0:14440:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:0.0:1788833048.647478:0:14440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a622b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.647494:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a622b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.647506:0:14440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a622b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.647513:0:14440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a622b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.647520:0:14440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a622b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.647526:0:14440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a622b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788833048.647556:0:14440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788833048.647606:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788833048.647622:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a622b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.647635:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d036ba800 already unused, calling callback (ffffffffc1438370) 00010000:00010000:2.0:1788833048.647641:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a622b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.647651:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d0647aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e168a9c-e2a0-4132-9a92-188a53d61a6f+22:14591:x1875726975499136:12345-192.168.206.41@tcp:35:lhsmtool_posix.0 Request processed in 1023us (1225us total) trans 8589934633 rc 0/0 00010000:00010000:2.0:1788833048.647659:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a622b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788833048.647667:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 14 00000020:00080000:0.0:1788833048.647678:0:14440:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788833048.647694:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff984d0a93b900) 00010000:00010000:2.0:1788833048.647700:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788833048.647707:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a622b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.647713:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d036ba800/0xd270a10c1c6a622b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.647768:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833048.647770:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788833048.647860:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788833048.747699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833048.748055:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975499392 00000100:00100000:2.0:1788833048.748069:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975499392 00000100:00100000:2.0:1788833048.748137:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 61 00000100:00100000:2.0:1788833048.748149:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+22:14601:x1875726975499392:12345-192.168.206.41@tcp:101:lfs.0 00010000:00010000:2.0:1788833048.748176:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788833048.748201:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6232 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5fabf05c11b5596f expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788833048.748439:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788833048.748579:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6232 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5596f expref: 24 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.748596:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff984d0a93b800) 00010000:00010000:2.0:1788833048.748599:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788833048.748606:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b702e00/0xd270a10c1c6a6232 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.41@tcp remote: 0x5fabf05c11b5596f expref: 24 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.748621:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff984d3b702e00, rc 0) 00000100:00100000:2.0:1788833048.748811:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+23:14601:x1875726975499392:12345-192.168.206.41@tcp:101:lfs.0 Request processed in 663us (1127us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788833048.748820:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 61 00000100:00100000:1.0:1788833048.751215:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:2.0:1788833048.751379:0:15471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975499520 00000100:00100000:2.0:1788833048.751392:0:15471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975499520 00000100:00100000:2.0:1788833048.751458:0:15471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 62 00000100:00100000:2.0:1788833048.751484:0:15471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d06478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+23:14601:x1875726975499520:12345-192.168.206.41@tcp:34:lfs.0 00010000:00010000:2.0:1788833048.751580:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6240 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.751600:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6240 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.751614:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6240 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.751632:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a6247 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.751639:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a6247 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.751646:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a6247 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752038:0:15471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a624e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752050:0:15471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a624e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752057:0:15471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a624e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788833048.752112:0:15471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a624e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752128:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6240 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752140:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6240 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752147:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6240 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752154:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703000 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788833048.752158:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6240 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752167:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6240 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752181:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff984d07e81c00) 00010000:00010000:2.0:1788833048.752184:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833048.752190:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6240 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752196:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703000/0xd270a10c1c6a6240 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752213:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a6247 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752218:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a6247 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752225:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a6247 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752305:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703a00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788833048.752314:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a6247 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752321:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a6247 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752330:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff984d06f05300) 00010000:00010000:2.0:1788833048.752333:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833048.752335:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a6247 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752342:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703a00/0xd270a10c1c6a6247 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752357:0:15471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a624e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752363:0:15471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a624e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752369:0:15471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a624e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752374:0:15471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff984d3b703c00 already unused, calling callback (ffffffffc1e824f0) 00010000:00010000:2.0:1788833048.752377:0:15471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a624e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752383:0:15471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a624e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752389:0:15471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff984d0a93be00) 00010000:00010000:2.0:1788833048.752392:0:15471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788833048.752401:0:15471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a624e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788833048.752407:0:15471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff984d3b703c00/0xd270a10c1c6a624e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788833048.752542:0:15471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d06478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e168a9c-e2a0-4132-9a92-188a53d61a6f+23:14601:x1875726975499520:12345-192.168.206.41@tcp:34:lfs.0 Request processed in 1058us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788833048.752551:0:15471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 62 00000100:00100000:0.0:1788833048.756510:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.41@tcp (source: 12345-192.168.206.41@tcp) 00000100:00100000:3.0:1788833048.757321:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726975499776 00000100:00100000:3.0:1788833048.757336:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726975499776 00000100:00100000:3.0:1788833048.757440:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.41@tcp, seq: 15 00000100:00100000:3.0:1788833048.757453:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3b7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+23:14601:x1875726975499776:12345-192.168.206.41@tcp:35:lfs.0 00000100:00100000:3.0:1788833048.757739:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3b7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e168a9c-e2a0-4132-9a92-188a53d61a6f+24:14601:x1875726975499776:12345-192.168.206.41@tcp:35:lfs.0 Request processed in 288us (1246us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1788833048.757775:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.41@tcp, seq: 15 00000001:00080000:3.0:1788833048.762958:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1788833048.762979:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00010000:00010000:1.0:1788833048.854373:0:15903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788833049.750400:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff984d3b7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994352384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788833049.750471:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788833049.750630:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726994352384 00000100:00100000:0.0:1788833049.750639:0:15126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726994352384 00000100:00100000:0.0:1788833049.750690:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788833049.750700:0:15126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff984d3aa3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994352384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788833049.750734:0:15126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788833049.750816:0:15126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff984d3aa3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875726994352384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788833049.750823:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788833049.750964:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788833049.750970:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff984d3b7d4700, transno 8589934595 00000004:00080000:2.0:1788833049.750985:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788833049.751011:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff984d3b7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875726994352384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788833049.884387:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788833050.241345:0:16702:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1788833050.902555:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29565 lines, 29565 kept, 0 dropped, 0 bad.